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Abstract. We present a logical framework for formalizing connections 
between finitary combinatorics and measure theory or ergodic theory 
C"| ■ that have appeared various places throughout the literature. We de- 

^ | velop the basic syntax and semantics of this logic and give applications, 

showing that the method can express the classic Furstenberg correspon- 
' dence and to give a short proof of the Szemeredi Regularity Lemma. 

We also derive some connections between the model-theoretic notion of 
stability and the Gowers uniformity norms from combinatorics. 

o" 

^3 ■ 1. Introduction 

+-> 

Since the 1970's, diagonalization arguments (and their generalization to 
ultrafilters) have been used to connect results in finitary combinatorics with 
results in measure theory or ergodic theory [13]. Although it has long been 
known that this connection can be described with first-order logic, a recent 
■ striking paper by Hrushovski [21] demonstrated that modern developments 

l/^ ', in model theory can be used to give new substantive results in this area as 

well. 

Papers on various aspects of this interaction have been published from a 
variety of perspectives, with almost as wide a variety of terminology [291 EU 
IS [H [311 EZ1 H]- Our goal in this paper is to present an assortment of these 
techniques in a common framework. We hope this will make the entire area 
more accessible. 

We are typically concerned with the situation where we wish to prove a 
statement 1) about sufficiently large finite structures which 2) concerns the 
finite analogs of measure-theoretic notions such as density or integrals. The 
classic example of such a statement is Szemeredi's Theorem (other examples 
can be found later in the paper and in the references): 

Theorem 1.1 (Szemeredi's Theorem). For each e > and each k G N >0 , 
there is an N such that whenever n > N and A C [l,n] := {1, . . . ,n} with 
^ > e, there exist a, d such that a, a + d,a + 2d, . . . , a + (k — l)d G A. 

Suppose this statement were false, and therefore that for some particular 
e, some k, and infinitely many n, there were sets A n C [l,n] serving as 
counter-examples to the theorem. For each n, we could view the set [l,n], 
together with the subset A n and the function + mod n, as a structure 9Jt n of 
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first-order logicfj]. Using the ultraproduct construction!!, these finite models 
can be assembled into a single infinite model 9Jt satisfying the Los Theorem, 
which, phrased informally, states: 

Theorem 1.2. A first-order sentence is true in 971 if and only the sentence 
is true in 9Jt n for "almost every" n. 

The existence of a and d satisfying the theorem can be expressed by a 
first-order sentence, so if we could show that this sentence was true in the 
infinite structure 9Jt, then the same sentence would be true in many of the 
finite structures 9Jt n , which would contradict our assumption. 

In each of the finite models, we have a natural measure on [l,n], namely 
the (normalized) counting measure /i n , and the assumption that > e is 
simply the statement that fi n (A n ) > e. We would like to produce a measure 
on 9JT which satisfies some analog of the Los theorem. 

One way to accomplish this is to expand the language of our models with 
many new predicates, one for each definable set S and rational 5, and specify 
that the formula mj^ holds in 9Jt n exactly if ^ n (S) < 5. Then, for instance, 
the failure of m^ e in the finite structures 9JT n implies the failure of the same 
formula in 9Ji. With a bit of work, these new predicates are enough to ensure 
that we can construct a genuine measure, the Loeb measure (see [H]), on 
the structure 50? whose properties are related to those of the finite structures 
via the Los theorem. 

In this paper, we define approximate measure logic, or AML, to be an ex- 
tension of first-order logic in which these new predicates are always present. 
We emphasize that AML is a conservative extension of first-order logic: any- 
thing done in AML can be translated back into the usual first-order logic 
by simply adding new predicates (we describe this translation in detail in 
Section [6J . 

While these approaches are similar, the model theory of AML does not 
simply reduce to the model theory of first-order logic. The reason is that 
results which alter the signature of the language behave differently: when a 
new predicate is added to first-order logic expanded by predicates describing 
a measure, the new predicate is unmeasured. Part of the motivation for this 
paper is the hope that a precise formulation of AML will promote the study 
of the model theory of this logic. (In particular, we were motivated by the 
realization that the results of [7] do not automatically apply to AML.) 

In general, a logic which intends to talk about measure has to make some 
kind of compromise, since there is a tension between talking about measures 
in a natural way and talking about the usual first-order notions (which, for 
instance, impose the presence of projections of sets). AML is not the first 
attempt at such a combination (see pHE]), but differs because it stays much 
closer to conventional first-order logic. The main oddity, relative to what a 

lr To keep this paper relatively self-contained, Appendix [X] gives a brief introduction to 
the parts of first-order logic used in this paper. 
2 See Appendix [B] 
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naive attempt at a logic for measures might look like, is that the description 
of measures in the logic is approximate: there can be a slight mismatch 
between which sentences are true in a structure and what is true about the 
actual measure. For instance, it is possible to have a structure 9Jt together 
with a measure \i so that satisfies a sentence saying the measure of a set 
B is strictly less than e while in fact the measure of B is precisely e. This is 
necessary to accommodate the ultraproduct construction. 

The next three sections lay out the basic definitions of AML and describe 
some properties of structures of AML, culminating in the construction of 
ultraproducts which have well-behaved measures. In Section [51 we present 
two examples of simple applications, giving a proof of the Furstenberg cor- 
respondence between finite sets and dynamical systems, and a proof of the 
Szemeredi Regularity Lemma. 

In Section [6l we describe the aforementioned translation of AML into first- 
order logic and use it to prove a Downward Lowenheim-Skolem theorem for 
AML. In Section we illustrate several useful model-theoretic techniques 
in AML and apply these to show a connection between definability, the 
model-theoretic notion of stability, and combinatorial quantities known as 
the Gowers uniformity norms. We intend this section to be a survey of 
methods that have proven useful. These methods are either more fully 
developed in the references, or await a fuller development. 

Finally, in Section [HJ we present axioms for AML and show that these 
axioms are sound and complete. 

In this article, m and n range over N := {0,1,2,...}. For a relation 
R C X x Y, x G X, and y G Y, we set R x := {y G Y : (x,y) G R} and 
R y := {x G X : (x,y) G R}. 

The authors thank Ehud Hrushovski and Terence Tao for helpful conver- 
sations on the topic of this E. 

2. Syntax and Semantics 

In this article, we let £q>o = {+,-,<, 0, 1, (c g ) g Q>o} denote the first- 
order signature of ordered rings augmented by constant symbols for each 
element of Q-°. We treat Q- as an £Q>o-structure in the obvious way. 
A signature for approximate measure logic (AML) is nothing more than a 
first-order signature. Suppose that £ is a first-order signature. In order 
to describe C-terms in AML, we first demand that there are only variables 
for the signature C Then one forms terms as usual, by applying function 
symbols to constant symbols and (in the case of the signature C) variables. 
We let Th arid T a denote the sets of £-terms and £q>o terms respectively. 
Observe that any term in T a actually names some element of Q- ; we will 
often identify a term with the nonnegative rational number that it names. 

Definition 2.1. We define the C-formulae of AML as follows: 

• Any first-order atomic £-formula and any first-order atomic (variable- 
free) £,Q>o-formula is an £-formula. 
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• The ^-formulae are closed under the use of the usual connectives -i 
and A. 

• If ip is an £-formula and x is a variable, then 3xf and Vx(p are 
/^-formulae. 

• If x = (x\, . . . , x n ) is a sequence of distinct variables, t is a term 
in T" a , X(E {<,<}, and ip is an £-formulae, then IX t.y? is an 
£-formula. 

The last constructor, which we will refer to as the measure constructor, 
in the above definition behaves like a quantifier in the sense that any of 
the variables x±, . . . ,x n appearing free in (p become bound in the resulting 
formula. 

From now on, IX will always denote < or <. 

Convention 2.2. It will become convenient to introduce the following no- 
tations: 

• rng — t-ty is an abbreviation for -^rng < t.<p 

• > t.(p is an abbreviation for < t.ip 

Remark 2.3. It is not necessary that AML contain precisely one measure 
for each tuple length. A more general definition could allow multiple mea- 
sures at each arity. In this case, one would also want to track which measures 
on pairs, for instance, correspond to the products of which measures on sin- 
gletons, and so on. There are even situations where it is natural to have a 
measure on pairs which does not correspond to any product of measures on 
singletonsJl Further generalizations could involve such things as measures 
valued in ordered rings. A fully general definition of AML would include in 
the signature £, for each arity, a list of measures together with the ordered 
ring in which they are valued. In this paper we eschew these complications 
and focus only on the simplest case, with a single real-valued measure; the 
changes needed to handle more general cases are largely routine. 

We next describe /^-structures in AML. An AML /^-structure SOT will 
be a first-order ^-structure with some additional information needed to de- 
fine semantics for the measure constructor. The idea is that the intended 
structures 5DT are naturally equipped with measures fi n on M n and these 
measures should tell us how to define the semantics of the measure quan- 
tifier; for example, if |x| = n, then mg < r.ip should be true in 5DT if and 
only if /i"({c£ M n : Wl |= tp(c)}) < r. (Of course, the previous sentence 
assumes that the definable set in question is measurable.) However, in order 
to do some model theory, one needs to be able to perform certain model 
constructions, e.g. ultraproducts, and it is not immediately clear how to to 

"^A typical example is the proofs in extremal graph theory of sparse analogs of density 
statements, as in the regularity lemma for sparse graphs [26], where the counting measure 
on pairs is replaced by counting the proportion of pairs from some fixed (typically small) 
set of pairs. If the fixed set of pairs satisfies certain randomness properties, this measure 
cannot be viewed as any product measure. 
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turn measures on the factor models into a measure on the ultraproduct in 
a way that preserves the semantics. 

Our solution is as follows: an AML prestructure SCR is a first-order re- 
structure that further specifies a collection B^ n C V(M n ) for each r £ Q-°, 
cxiG {<,<}, and n > 1. One should think of the statement X E £>^ n as 
declaring that the "measure" of X C Af n is < r. Of course, for this analogy 
to be accurate, the collection of B^f 1 should satisfy some further properties; 
this will lead us to the notion of an AML C-structure, which we describe 
shortly. However, we first want to describe the semantics of AML for an 
arbitrary prestructure. (This will be useful in Section [6l) 

Suppose that SCR is an AML £-prestructure. Let V be the set of variables 
and suppose also that s : V — > M is a function; we call such ansa valuation 
on SCR. Given any sequence of distinct variables v = (vi, . . . ,v n ) and any 
sequence c = (ci, . . . , c n ) from M, we let s(c/v) be the valuation obtained 
from s by redefining (if necessary) s at Vi to take the value Cj. As in first- 
order logic, we inductively define the satisfaction relation SCR |= <p[s\. As 
usual, one defines the satisfaction relation by recursion on the complexity of 
formulae. One treats the atomic case as well as the connective and quantifier 
cases as in first-order logic. In order to specify the semantics of the measure 
constructor, suppose that <p is an AML ^-formulae for which satisfaction 
has already been defined and suppose that x is a tuple of distinct variables 
with \x\ = n. Then we declare SCR |= mg cxi t.cp[s] if and only if there is 
B € such that {c 6 M n : £DT (= ip[s(c/x)]} C B. 

Remark 2.4. Observe that there is something constructive about the se- 
mantics of the new constructor in the sense that to show that 9JT |= 
ix t.(p, the prestructure must specify a witness to this fact. 

As is customary, we often write SOT |= <p(a) if tp{x) is a formula with free 
variables among x, s is a valuation for which s(xi) = and 59T |= (p [s]. If (p 
has no free variables, then ip is called a sentence. If T is a set of sentences, 
we write SOT |= T if and only if SOT (= </? for all </5 G T; in this case, we say 
that SCR is a model of T. 

Example 2.5. Let £ be the signature consisting of a single binary function 
symbol • and a single constant symbol e. Let G be a group with \G\ = m. We 
view G as a first-order ^-structure (5 by interpreting • as multiplication in 
G and e as the identity of G. In order to view & as an AML £-prestructure, 
we must specify the sets B^™. We do this by declaring, for X C G™, that 
X € £fe n if and only if j^j txi r; this is analogous to equipping each cartesian 
power G" 1 with the (normalized) counting measure. Now fix g € G and let 
(p(x,y) be the first-order £- formula x ■ y = y ■ x. Then & |= m x < r.ip(g) if 
and only if the cardinality of Ccig), the centralizer of g in G, is < r • m. In 
particular, if r < 1, then <3 \/= \/ym x < r.tp as the centralizer of the identity 
has cardinality m. 
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An AML structure is an AML prestructure subject to some additional prop- 
erties, which will be defined after some notation is set. 



Notation 2.6. Suppose that 5DT is an AML prestructure. 
• *-W - — Un>l °w • 



B G if B C C for some C G B^f 1 ; likewise for <. 



• Bf; n := P(M n ) \ B^' n and B^.' n := T(M n ) \ B 



Observe that we may now rewrite the semantics of the measure construc- 
tor by declaring that Wl |= m$ oo r.ip[s] if and only if 



{c G M n :Wl\= ip[s(c/x)} G B^ n . 

As in classical logic, we say that D C M n is definable (in VJl) if there is 
a formula ip(x,y), with |x| = n, and a G such that D = {x G M n : 
Wl |= tp(x, a)}. In this case, we sometimes write D = ip(M n ,a) or even 
D = tp(M, a). If A C M and the tuple a as above lies in A, we also say that 
D is A-definable (in Wl) or definable (inWl) over A. We let Def n (M) denote 
the Boolean algebra of definable subsets of M n . A function h : M m ->■ M™ 
is definable (inWl) if the graph of /i is a definable subsets of M m+n . 

Definition 2.7. Suppose that Wl is an AML £-prestructure. Then Wl is an 
AML C-structure if and only if the collection of B^ r . satisfy the following 
properties, for ri,r' 1 ,r2,r' 2 G Q-°: 

• (Coherence) if n < r 2 , then B^ C B^ C i3™ 2 . 



(Emptiness) G B^ n and B^ n 



• (Finite additivity) 



Suppose that B; G fig" for i = 1, 2. Then B 1 UB 2 £ Bf;[ 
If in addition B 2 G then Bi U B 2 G 



-'<r2 ' -"1 ^2 <J <ri _|_ r2 . 

- Suppose that B; G n #f', n for i = 1,2 and B x n B 2 = 
0. Then Bi U B 2 G Bg" +r2 . If in addition B 2 G B^£, then 

B 1 UB 2 GB^ +r2 . 

• (Products) Suppose that ni,n 2 > 1 and n = n\ + n 2 . 

- Suppose that Bi G Sg™ 1 for i = 1, 2. Then B : x B 2 G Bg™^. 

If in addition B 2 G £< r '", then B x x B 2 G B^'" r2 . 

- Suppose that B; G B> r f for i = 1,2. Then B x x B 2 G fig"^. 
If in addition B 2 G B^.'™, then Bi x B 2 G B^,'™. r2 . 

• (Definability) Def„(M) n S^" C B^ 

Convention 2.8. From now on, when we say that 9Tt is an £-(pre)structure, 
we mean that Wl is an £-(pre)structure of AML. We use fraktur letters 9Jt 
and 9T (sometimes decorated with subscripts) to denote prestructures. The 
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corresponding roman letter denotes the underlying universe of the prestruc- 
ture. (So, for example, the underlying universe of Wt will be M and the 
underlying universe of 9Tj will be iVj.) Likewise, /^-formulae will always 
mean AML /^-formulae. If we wish to consider a structure from classical 
first-order logic, then we will speak of a classical structure and denote it 
using calligraphic letters such as M. Likewise, we will speak of classical 
formulae. 

Remark 2.9. There are further properties that one might want to consider 
on /^-structures: 

• (Monotonicity) For every r G Q- and every n ^ 1, — $>qr • 
The Monotonicity axiom is a harmless axiom to impose. Indeed, 
if 9Jt is any /^-structure of AML, then one can take its "monotone 
closure" 9Jl mc ; this is defined by saying B G B^ r if and only if 
B G B^ r . It is easy to see that the identity map id : 9JJ — > 9Jt mc is 
an elementary map (to be defined later), so preserves the truth of 
all formulae. 

• (Invariance under permutation of coordinates) Suppose a is a per- 
mutation of {1, . . . , n} and B C M n . Define cr(B) by declaring 

(x 1 ,...,x n ) £B» {x a (i),---,x*(n)) G a(B). 

Then we demand B G <^ <j(B) G B^a™- Since there are mea- 

sures on M n that need not be invariant under coordinate permu- 
tation, it is not reasonable to require that this property hold in all 
structures. 

Suppose that Wl and 9t are £-prestructures. A (weak) homomorphism is 
a map j : 9Jt — > OT which is a homomorphism of first-order structures and 
such that, for every r G Q-° and every B G B^ r , we have j(B) G B^ r . 
We say that Wl is a sub-prestructure of 9T if the inclusion map M ^ N 
is a homomorphism. An isomorphism is a bijective homomorphism whose 
inverse is also a homomorphism. 

The notion of an elementary embedding between £-prestructures is the 
same as in first-order logic: j : 9Jt — > OT is an elementary embedding if, for 
any /^-formula tp(x) and any tuple a from M, we have 

Wl |= ^(a) & m \= <p(j(S)). 

A proof by induction on the complexity of formulae shows that isomorphisms 
are elementary embeddings. We say that 9Jt is a elementary sub-prestructure 
of 91 if 9K is a substructure of 91 and the inclusion map M > N is an 
elementary embedding. 

Suppose £ is signature extending the signature C. Suppose that Wl 
is an £'-prestructure. Then the C-reduct of 9Tt, denoted is the C- 

prestructure obtained from 9Jt by "forgetting" to interpret symbols from 
£ \ C. We also refer to Wl as an expansion of Wl\£. 
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We say that the £-prestructure is a modification of the £-prestructure 
SCt if M = N, SDt and 91 interpret the first-order structure in the same way, 
and B^ r C B^ r for each r G Q-°. Suppose that S is a set of /^-formulae. 
Then we say that the modification is conservative with respect to S if the 
identity map M — > M is an elementary embedding with respect to formulae 
from S. 

3. The Canonical Measures on an Hi-saturated AML structure 

An extremely important source of AML structures are those that are 
equipped with a measure. 

Definition 3.1. A measured C-structure is an AML ^-structure 9JT such 
that there is a measure v n on a u-algebra B n of subsets of TV 1 extending 
Def n (M) such that: 

(1) For definable B C M n , we have v n {B) = inf{r G Q >0 : B G £< r ' n }. 

(2) For each m,n> 1, the measure u m+n is an extension of the product 
measure v m % v n 

(3) (Fubini property) For every m, n > 1 and i? G B m+n , we have 

(a) for almost all x £ M m , B x £ B n ; 

(b) for almost all y G M n , B y G B m ; 

(c) the functions x i-> u n (B x ) are y i-> v m {B y ) are z^ m - and z/ n - 
measurable, respectively, and 



For example, any finite /^-structure equipped with its normalized count- 
ing measure is a measured structure; in fact, these structures (and their 
ultraproducts) are our primary examples of measured structures. 

Even if an AML structure does not come equipped with a measure, often 
there is still a "natural" measure that can be placed on the structure, a 
process that we now describe. First, we say that an /^-structure 9Jt is Ni- 
saturated if whenever n > 1 and (D rn : m G N) is a family of definable 
subsets of M n with the finite intersection property, then HmeN ^ m ^ ®- 
For example, any finite /^-structure is Hi-saturated; many ultraproducts are 
also Hi-saturated. In this section, we will show that certain Hi-saturated 
AML structures can be equipped with a family of canonical measures, the 
so-called Loeb measures. 

Suppose that Wl is an AML ^-structure. We define 



p ,n := p n : Def n (M) -> [0, +oo], p n (B) := inf{g G Q > : B G B J ^ n }. 



Observe that p n is a finitely additive measure. Now further suppose that 
9JT is Hi-saturated and (A m : m G N) is a family of definable subsets of 
M n for which [j me ^A m is also definable. Then, by Hi-saturation, we have 

that [j meN A m = Um =0 4i for some k G N. Consequently, p n \ Def n (M) is 
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a pre-measure. Thus, by the Caratheodory extension theorem, there is a 
measure := [i n : <r(Def n (M)) — > [0, +00] extending p n given by 

fi n (B) := mi{Y / P n (D m ) ■ Bc\jD m ,D m € Def n (M) for all m}. 

m m 

Moreover, if p n \o~(Def n (M)) is cr-finite, then [i n is the unique measure on 
cr(Def n (M)) extending p n . Observe, however, that by Hi-saturation again, 
p n \ Def n (M) is cr-finite if and only if p n \ Def n (M) is finite (which occurs if 
and only if p (M) is finite by the product property). We refer to the family 
of measures {^r m,n ) as the canonical measures on 93T. Although they are 
defined for all Ni-saturated /^-structures, we mainly consider them in the 
case when p 1 (M) is finite, for then they are truly "canonical." 

Until further notice, we assume that p 1 ] Defi(M) is a finite pre-measure 
on Defi(M) (and hence p n \ Def n (M) is a finite pre-measure on Def n (M) for 
all n > 1). Let <r(Def m (M)) <g) c(Def n (M)) denote the product cr-algebra 
and fj, m <g) /U n denote the product measure. Observe that cr(Def m (M)) (g) 
a(Dei n (M)) is generated by sets of the form A x B, with A G Def m (M)) 
and B G Def„(M)); since A x B G Def m+n (M) for such A, B, we have 
cr(Def m (M)) (8) cr(Def n (M)) C a(Def m+n (M)). Now observe that, if A G 
Def m (M) and B G Def n (M), then p m+n (A x B) = p m (A) -p n {B) by the 
Product property. Thus 

E := {D G a(Def m (M)) ® a(Def n (M)) : fi m+n (D) = (pT ^ n ){D)} 

contains all sets of the form Ax B, where A G Def m (M) and B G Def„,(M). 
One can easily check that E is a A-class. Since the sets of the form Ax B, 
where A G Def m (M) and B G Def n (M), form a 7r-class, we have, by the 
vr-A Theorem, that a(Def m (M)) <g) a(Def n (M)) C E. (For the definitions 
of A- and 7r-classes as well as the statement of the 7r-A-theorem, see Section 
17.A of [23].) Consequently, we see that pT ® fx n = /i m+n |a(Def m (M)) ® 
a(Def„(M)). 

We call an ^i-saturated /^-structure whose canonical measures satisfy the 
Fubini property a Fubini structure. (The measurability of the functions in 
(3) always holds for the canonical measures, so really a Fubini structure is 
one where the displayed equation in the statement of the Fubini property is 
required to hold.) A Fubini structure, equipped with its canonical measures, 
is a measured /^-structure. 

The following situation is also important: 

Definition 3.2. Suppose that M. is a classical ^-structure which is equipped 
with a family of measures v n on a cr-algebra B n of subsets of 9K n such that 
v m+n j s an ex tension of v m v n for all m, n > 1. We call (Ai,(v n )) a 
classical measured structure. Then we can turn M into an /^-structure 9Jt 
by declaring, for B C M n , that B G B™/ 1 if and only if B G B n and 
v n (B) ex] r. We call Wl the AML structure associated to (M, {v n )). 
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Remark 3.3. Suppose that Wl is an Ni-saturated /^-structure with p 1 (M) 
finite. Consider the family of canonical measures. Let M. be the clas- 
sical .C-structure obtained from 9JT by considering only the interpretations 
of the symbols in C. Then (M,(fi n )) is a classical measured structure. 
Let SOT' be the AML structure associated to (M,(fi n )). How do Wl and 
Wl' compare? Well, suppose that tp(x) is a classical £-formula and that 
9JI |= m x < r.ip(x). Then <p(M) G B^ r , so fi((p(M)) < r. Consequently, 
|= m x < r.{p(x). However, the converse need not hold. For exam- 
ple, suppose that <p(M) G Bf r for each r G Q >0 but ip(M) <£ B%. Then 
fi(<p(M)) = 0, whence Wl' |= m x < 0.(p(x) while Wl^ |= m x < 0.tp(x). (Such 
phenomena can, and will, happen in ultraproducts, as we will see in later 
sections.) Thus, in some sense, 9JI' is a "completion" of Wl. 

We now briefly turn to the question of what our logic can say about these 
canonical measures. We present a couple of examples. Suppose that (X, S) 
is a measurable space such that {x} G S for every x G X. (This happens, 
for example, when (X, S) = (M n , <r(Def n (M)) for 971 an ^-structure.) Then 
a measure /i on X is said to be continuous if n({x}) = for each x G X. 

Proposition 3.4. Suppose that 5DT is an Hi-saturated C-structure. Then we 
have Wl |= {ixm y < q(x = y) : q G Q >0 } «/ and on/y z/ /U 1 is a continuous 
measure. 

Proof. First suppose that 9Jt |= {Vxm^ < q(x = y) : q G Q >0 }. Fix 
a G M. For each g G Q >0 , let £ 9 G B^ 1 be such that a G B q . Then 

M 1 ({ a }) = P 1 ({ a }) = 0- Conversely suppose that fj, 1 is a continuous measure 
and fix a G M and g G Q >0 . Then there is B q G B^ q such that a G B q . 
Then 9Jt |= < q(a = y). Since a G M is arbitrary, we have 9Jt |= \/xm y < 
q(x = y). □ 

What we really proved is that there is a set T(x) consisting of /^-formulae 
containing a single free variable x such that, for every /^-structure Wl and 
every a G M, 

^({a}) = £Dt |= 99(a) for all 92 G T. 

In model-theoretic terms, the set of elements of //-measure is uniformly 
type-definable in all Hi-saturated /^-structures. Below, as a consequence 
of the ultraproduct construction, we will see that this set is not uniformly 
definable in all /^-structures. 

Here is another proposition along the same lines. 

Proposition 3.5. There is a set T of AML sentences such that, for any 
^i-saturated C-structure 9Jt with p 1 (M) finite, Wl \= T if and only if fi 1 is a 
probability measure. 



Proof. Take T := {m x < l(x = x)}U{->m x < q(x = x) : q G (0, 1)DQ}. □ 
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Proposition 3.6. There is a set T of AML sentences such that, for any 
Hi-saturated C-structure 9JT with p l {M) finite, 90T |= T if and only i/ SOT is a 
Fubini structure. 

Proof. We take T to be the following scheme: 

(1) \/z [(t < qr A Vx(Y> — > mg > r.ip) A m$ > q.if) — > rn$^ > t.{ip A tp)] 

(2) Mz [(gr < t A \/x(tp — > mg < r.ip) A m$ < q.if) — > < t.(ip A tp)] 
for every ip(x,y, z),ifr(x, z), q,r,t. Note that ^ may not contain variables 
from y. 

Suppose DOT \= T. It suffices to show that for any definable set B C 
M m+n , we have fi m+n (B) = J fi n (B*)dfi m (x). Fix a formula ip(x,y) so 
that B = {(x,y) G M m+n : SOT 1= <p(x, y)}. Given rationals r,r', we set 
5 r r / = {x : SOT 1= > r.ip(x, y) A < r'.<p(x, y)}; we will also write -B r)r ' 
as an abbreviation for its defining formula. 

Observe that we can approximate the function x i-> /j, n (B x ) by step func- 
tions of the form J2i r iXB ri . ri+1 for sequences of rationals r\ < ■■■ < rj,. 
Let ri < • • • < rk be such a sequence of rationals. For any rational 
qi < fi m (B rijri+1 ), we must have SOT \= > qi.B ruri+1 . Since SOT 1= T, 
we must have 

m\= m s> $ > t.(<p A B run+1 ) 
for every t < q^n, and so ^ m+n ({(x,y) G B : x G £r;,r i+ i}) > ^r,. 
Since the B ritTi+1 are pairwise disjoint, it follows that fi m+n (B) > J2iQi r i- 
Since we may choose gj,rj as above so that YliQi r i ^ s arbitrarily close to 
f H n (B*)dn m {x), we have pI n+n {B) > J /j, n (B s )d/j, m (x) . 

Similarly, for any qi > fj, m (B rit r i+1 ), we must have SOT 1= < qi.B ruTi+1 , 
and since SOT 1= T, we also have 

SOT 1= m s $ <t.((pA B run+1 ) 

for any t > qir i+1 . Therefore fi m+n ({(x,y) £ B : x G B run+1 }) < %r i+ i, 
and so fi m+n (B) < ^ Again, since Yli Qi r i+i can be made arbitrarily 

close to / fi n (B s )dn m {x), we have n m+n (B) < J fi n (B*)dfi m (x). 

Now suppose SOT is Fubini; we must show that every sentence in T holds. 
For the first family of sentences, suppose SOT 1= \/x(ifj — > mg > r.ip) A > 
q.tp[s]. Then C = {c G M m : SOT N ^[s(c/x)}} £< 9 ' m , and therefore n(C) > 

q. Let B = {(c,d) G M m+n : c G C and SOT \= ip[s(c/x, d/y)]}. For each 
c G C, > r. Since /i is Fubini, fi m+n (B) = f c ^ n (B*)dn n {x) > qr, and 

therefore for each t < qr we have B G" 23^' m+n , so SOT 1= > t.((p A V')[ s ]- 

For the second family of sentences, suppose SOT 1= \/x{ip — > < r.ip) A 
mg < q.ip[s}. Then C = {c G M m : SOT t= ip[s{c/x)}} G ^< g m , and therefore 

/i(C) < g. Let B = {(c,d) G M m+n : c £ C and SOT 1= <p[s(c/x,d/y)]}. For 
each c G C, < r. Since n is Fubini, fj, m+n (B) = f c n n (B s )dfj, n (x) < 

qr, and therefore for each t > qr we have B G B^ m+n , so SOT 1= < 
t.((pAip)[s]. □ 
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Remark 3.7. Fix T as in the proof of the previous proposition. The proof 
we have given above shows that 9JT |= T for any measured structure 9JX. 

4. Ultraproducts 

We suppose that the reader is familiar with the standard ultraproduct 
construction from first-order logic; the reader unfamiliar with this construc- 
tion should consult Appendix B. 

Suppose that (9Jtj : i G /) is a family of /^-structures and suppose 
that U is an ultrafilter on /. We let Wl denote the classical ultraproduct of 
the family (SDTj) with respect to U. We make TX into an £-prestructure by 
declaring that B G B^ n if and only if there is a sequence (Bi : i G /) such 
that Bi G £> M r' n for ^/-almost all i and such that B = \\ u Bi. 

The following theorem is of fundamental importance for our applications 
of AML. 

Theorem 4.1 (Los Theorem for AML). Suppose that (9JTj : i G /) is a 
family of C- structures, U is a nonprincipal ultrafilter on I, and SOT = \\ u 9Hj 
is the ultraproduct of the family (Wli). Let (p be an C-formula and s a 
valuation on Wl. For each i £ I, let s« be a valuation on 9Jtj such that, 
for each variable v, we have s(v) = [si(v)]u- Then TX |= <p[s] <^ |= 
f[ s i] for U-almost all i. 

Proof. The proof is by induction on the complexity of (p. The only new case 
to consider is the case of the measure constructor. In the remainder of this 
proof, we suppose that x is a tuple of distinct variables with \x\ = n. First 
suppose that 9Jt |= mg 00 t.y>[s]. Then there is B G B^ t such that {c G 
M n : Wl |= tp[s(c/x)]} C B. We can write B = \[ U B U where B< G B^ 
for ZY-almost all i. Suppose that {c G M" : Wli \= (p[si(c/x)]} % Bi for 
^/-almost all i. Then for U- almost all i, there is c~l G Mf \ Bi such that 
|= (p[s{ci/ 'x)\. For the remaining i, choose c*j G M\ l in an arbitrary 
fashion; set c := [cl] G M n . Then by the induction hypothesis, we have 
Wl |= ip[s(c/x)} and yet c^B, which is a contradiction. 

Conversely, suppose that TXi |= tx\ t.<p[s] for ^-almost all i. For these 
i, let Bi G B™l be such that {c G M" : SPTi |= ^([^(c/x)]} C B i5 for the 
remaining i, let -B, denote any nonempty subset of M™. Let B := \\ u Bi G 
B^ t . Suppose, toward a contradiction, that there is c = [cl] G M n such 
that Wl |= (/9[s(c/x)] and yet c ^ B. Then, for ZY-almost all i, we have 
|= ip[si(cl/x)] and yet q ^ Bf, this is a contradiction. □ 

Lemma 4.2. T/ie ultraproduct TX is an C-structure. 

Proof. The Coherence and Emptiness properties are clear. We now prove 
the Finite Additivity property. Suppose that B G B^ r and C G B^ s . Write 

B = flu Bi and C = flu^i- For the large set of i satisfying Bi G B^j 

and d G let A G £;f; +s be such that BjUCjCDj. Then 5UCC 

rj^(-E>i U Cj) C Yiu Di G #<|. +s - It is easy to see that this argument also 
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covers the case that C G B^ s and that this argument can easily be modified 
to prove the first half of the Product property. 

Towards proving the second half of the Finite Additivity property, suppose 
that B G Bf r nBf r , and C G Bf s C\Bf s , and that BnC = 0. Since B G Bf r ,, 
we can write B = \\ u B{. Likewise, C = YhjCi. Since hi is an ultrafilter, 
it follows that B { D C* = 0, B { G B™; and C { G for W-almost all i. 
For these i, let Di C £?j U Cj be such that Dj G S^! +g . Note also that 
B U C = n( 5 i u Cj) since -Bj n Cj = for W-almost~all i. It follows that 
HyDiQBUC; since ]l w A G Bf r+S , we have that BUC £ Bf r+S . Again, 
this argument also covers the case that C G £>™ and can be modified to 
prove the second half of the Product property. 

If B G Def ft (Af) n fiS" then £ = U u Bi where each G Def n (M;) and 

for ZY-almost every i, Bi G B^' n ' . By the Definability property for the Mj, 
for ^/-almost every i we have -Bj G £w l ' n , and therefore .B G B^ 11 . □ 

Corollary 4.3. WWi i/te same hypotheses as in the previous theorem, if a 
is an C-sentence, then 

SXTt |= a 44> |= a for lA-almost all i. 

Corollary 4.4 (Compactness Theorem for AML). If S is a set of C- 

sentences such that each finite subset of S has a model, then £ has a model. 

Proof. The usual ultraproduct proof of the Compactness theorem from the 
Los theorem applies; see, for example, Corollary 4.1.11 of [6]. □ 

Corollary 4.5. For any C-structure 9Jt, any set I, and any nonprincipal 
ultrafilter hi on I, the diagonal embedding j : 9Jt — > DJI^ 1 given by j(a) = 
[( a )]t( is an elementary embedding. 

The following result is proven in the classical context in Appendix B; this 
proof carries over immediately to the framework of AML. 

Proposition 4.6. Suppose that hi is a countably incomplete ultrafilter on a 
set I and suppose that C is countable. Suppose that (SEJt, : i £ I) is a family 
of £- structures. Then \\ u 9Jtj is Ni- saturated. In particular, if I = N and 
hi is any nonprincipal ultrafilter on N, then YluVJli is ^i-saturated. 

Consequently, an ultraproduct SOT for which p® 1,1 is finite can be equipped 
with its canonical family of measures. (Observe that, by the Los theorem, 
p 3 ^' 1 is finite if and only if p^' 1 is finite for ^-almost all i.) These mea- 
sures are instrumental for our applications of AML to problems in finite 
combinatorics and ergodic theory. 

We can also use the Los theorem to show that properties of the canonical 
measures on the factor models are inherited by the canonical measures on 
the ultraproduct. 

Corollary 4.7. Suppose that (SOtj : i G /) is a family of Fubini structures, 
hi is a nonprincipal ultrafilter on I, and Wl = Yln^Oli- Suppose further that 
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there is a c £ R >0 such that p 1 (Mi) < c for U-almost all i. Then DJl is a 
Fubini structure. 

Proof. This is immediate from Proposition 13,61 and the Los theorem. □ 

Corollary 4.8. Suppose that (93tj : i £ I) is a family of ^-saturated C- 
structures such that /r" 1 *' 1 is a continuous measure for almost all i. Suppose 
that U is a nonprincipal ultrafilter on I and 971 = Y\u -^i- Then is also 
a continuous measure. 

Proof. This is immediate from Proposition 13,41 and the Los theorem. □ 

Remark 4.9. Under some set-theoretic assumptions, the converse of the 
above corollary holds. A nonprincipal ultrafilter Wona (necessarily uncount- 
able) index set I is said to be countably complete if whenever (D m : m £ N) 
is a sequence of sets from U such that D m D D m+ \ for all m, we have 
DmeN Dm £ U. With the same hypotheses as in the previous corollary, if we 
further assume that U is countably complete, then continuity of /i^' 1 im- 
plies continuity of almost all fjF 1 ^' 1 . The existence of a countably complete 
ultrafilter is tantamount to the existence of a measurable cardinal, which is 
a fairly mild set-theoretic assumption that most set theorists are willing to 
assume when necessary. However, it is straightforward to check that if IA is 
countably complete and each 9Jtj is finite, then Y\u wm a ls° be finite, 
making such ultraproducts unusable for many purposes. 

Corollary 4.10. There does not exist an C-formula <p(x) such that for every 
^i-saturated C-structure 9Jt, we have 

t J m ' 1 ({a}) = 0^Tl\=ip(a). 

Proof. Suppose, towards a contradiction, that such an £-formula <p(x) ex- 
ists. For i > 1, let 9JTj be the classical measured ^-structure whose universe 
is {l,...,i}, whose measures are given by the normalized counting mea- 
sures, and which interprets the £-structure in an arbitrary fashion. Let 
be the AML £-structure associated with 9Jtj. Let IA be a nonprincipal 
ultrafilter on N >0 and let Wl = Uu^i- Since M * £ ^l' 1 for each ^ we 
have M £ B^ 1 . Thus, p m ' 1 (M) < 1, whence n m '\M) < 1. Also observe 
that j> OT,1 ({a}) = for any a £ M by the Los theorem. It follows that 
DJt \= Vxtp(x). By Los again, we have that 9JTj |= \/x(p(x) for some i £ N >0 . 
Since 9Jtj is ^i-saturated, it follows that each m £ Mi has measure 0, which 
is a contradiction. □ 

Corollary 4.11. There does not exist an C-sentence tp such that, whenever 
DJl is an ^i-saturated structure with // 1 (M) finite, then 9JI |= <p if and only 
if /i 1 is a probability measure. 

Proof. Suppose, towards a contradiction, that such a sentence <p exists. For 
n > 1, let 9JT n be a finite /^-structure such that // 1 (M„) = 1 — -. Let 
9Jt := Ilw^n> where U is a nonprincipal ultrafilter on N >0 . Observe that 
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SEJt |= m x < l.(x = x), so p 1 (M) < 1. However, 9Jt |= —<m x < l.(x = x). 
Consequently, n (M) = 1, whence 9JI \= <p. Thus, Wl n |= ip for some n, 
contradicting the fact that [i (M n ) < 1. □ 

Corollary 4.12. There does not exist a set T of C- sentences such that, for 
any C-structure 9Jt, SEJt (= T if and only if p^' 1 is a -finite. 

Proof. Suppose, towards a contradiction, that there is a set T of /^-sentences 
such that 9Jt |= T if and only if is cr-finite. Let M be a countably infinite 
set equipped with the unnormalized counting measure v(B) = \B\ and turn 
M into an AML £-structure SOT by interpreting the symbols in C in an 
arbitrary fashion. Note that 9Jt |= T because 9JT is the union of its singletons, 
which are definable and have measure 1. Let IA be a nonprincipal ultrafilter 
on N and let 9T := 9Jt^. Then, by the Los theorem, we have that 9T |= T, 
so p^ 1 is cr-finite. Since 91 is wi-saturated, we have that fi 1 '^ is a finite 
measure. Thus, for some n G N, 9t |= ~3xi ■ ■ ■ 3x n (/\" =1 -vm x < l.(x = Xi)). 
Consequently, Wl |= Sxi ■ ■ ■ 3a; n (/\" =1 ^m x < l.(x = Xi)), contradicting 
the fact that M contains infinitely many singletons of measure 1. □ 

We now turn to the connection between integration and ultraproducts. 
First, we need a lemma. 

Lemma 4.13. Let (9Jtj : i G I) a family of C- structures, U a nonprincipal 
ultrafilter on I, and set 9JT := Ilw^- fi^^v) be a formula, with \x\ = 
m. Fix Si G for all i and set a := \a,j\u- Consider the definable sets 
Ai := {x G M™ : 9JT; N tp(x, Si)} and A := {x G M n : 9JT \= cp(x, a)}. Then 
p™> n (A) =]hnup Sk > n {A i % 

Proof. Fix q G M >0 . We have 

p ' n (A) < q 44> 9JT N mg < r.cp(x, S) for some r < q. 

By the Los theorem, the displayed statements are equivalent to the state- 
ment that there is r < q such that Wli ^ m x < r.<j){x, Si) for ^-almost every 
i, which is in turn equivalent to p^ i,n (Ai) < r for ^/-almost every i. Since 
this holds for every q G R >0 , it follows that p <m ' n (A) = \im. u p m ^ n (Ai) . □ 

Suppose that (971, : i G J) is a family of /^-structures and /ij : M™ — > 
are functions. We will say that the family (hi : i G J) is uniformly definable 
if there exists a formula ip(x,y,z), where \x\ = m and \x\ = n, and tuples 
Si G mI^ 1 such that, for alH G I, a G Mf 1 and & G Mf, we have /i;(a) = 6 
if and only if 9Jtj |= <p(a, b, Si). If 9Jt = ^ an d c := [ci]u, then by Los, 
we have that (f(x, y, c) defines a function h : M m — > M n , which we call the 
ultraproduct of the uniformly definable family (hi). 

In the following theorem, the bound of 1 can easily be replaced by any 
positive real number. 



For a family of real numbers (r< : i € I), lim^ n denotes the ultralimit of (n); see 
Appendix iBl for more on this notion 
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Theorem 4.14. Suppose that (£PTj : i £ I) is a family of measured C- 
structures with fij(Mi) < 1 for each i £ I. Suppose that U is a nonprincipal 
ultrafilter on I and := \\ u Wli is equipped with its canonical measures 
(fi m ). For each i £ I, let gi : — > [—1,1] be a measurable function. 
Then there is an expansion of 9Jt and a measurable (with respect to 
B^' 71 ) function g : M n — > [—1,1] such that, for every uniformly definable 
family (hi : i E I) of functions of m variables with ultraproduct h, we have 
J(goh) d^ m = lim w / (g { o h { ) dpf. 

Proof. Consider the extension £' of C obtained by adding, for each q E 
Qn [— 1, 1], a new unary predicate G q . We define expansions Wl^ of Wli to £- 

structures by interpreting G q 1 = {x E Mj 1 : gi(x) < q}. Let 9JT := [] w 2tJ, 
and define g(x) = inf{g E Q >0 : Tl' t= G q (x)}. It is clear that g is B m '' n - 
measurable. 

Now suppose that (hi : i E /) is a uniformly definable family of functions, 
say defined by (p(x, y) (and some parameters, which we suppress for sake of 
exposition), with ultraproduct h. Set m := |x| and n := \y\. Fix c E Q >0 
and choose a partition — 1 = qo < q\ < ■ ■ ■ < q^ = 1 of [— 1, 1] such that that 
|gfj — qj+i\ < 1/c for each j < k. Set 

S?™ +1 := {£ E M™ : Qj < ( 9l o h,)(x) < q J+1 } 

and 

S g 3 ,g ]+ i {xeM m : qj <(go h)(x) < q j+1 }. 

Then for each j < k, the sets sf Ai+1 and are as in the hypothesis of 

LemmaE3l whence / u m (5*'*+ 1 ) = lim u ^{Sf ,<?J+1 ). Since we have that 

and 

^. +1 /i m (,S^+i) - 1 < / (90/1)^ < J^ +lM "»(S*>*+i), 
i j 

by taking ultralimits, we have | lim^ f(g% ° h^d^ij 1 — J(g o h)dfi m \ < -. 
Letting c go to 00, we have the desired result. □ 

We call the function g as in the conclusion of the previous theorem the 
ultraproduct of the family (gi). Observe that g(x) = lim^ gi(xi) for x = [xi]u- 
We will particularly be interested in the case that / = N, in which case, 
using the same notation as in the statement of the previous theorem, if 
lim^oo f(go hi) dpi™ = r, then f(goh) d[i m = r. 

5. Correspondence Theorems 

5.1. The Furstenberg Correspondence Principle. One application of 
AML is to give a general framework for correspondence principles between 
finite structures and dynamical systems. We will only present a proof of 
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the original correspondence argument given by Furstenberg [13]; since then, 
many variations and generalizations have been produced (for instance, [5]). 
The method given extends immediately to these generalizations. 

Definition 5.1. Let £CZ. The upper Banach density of E, d(E), is 

\[n,m]nE\ 
hmsup . 

m— n— >oo 771 71 

Definition 5.2. A dynamical system is a tuple (Y,B, fi,T), where (Y,B,fi) 
is a probability space and T : Y — > Y is a bimeasurable bijection for which 
ijl{A) = n(TA) for all A £ B. 

Furstenberg's original correspondence can be stated as follows: 

Theorem 5.3 (Furstenberg). Let £CZ with positive upper Banach density 
be given. Then there is a dynamical system (Y, B, fi, T) and a set A G B with 
fj-(A) = d{E) such that for any finite set of integers U , 

d{^(E-i))>^T- l A). 

Proof. Let (ejv ■ N € N) be an increasing sequence of positive rational 
numbers such that sup^e^ = d(E). Then for each N, we may find n,m 
such that m — n > N and ^^l^ > en- Let /„ >m : [n,m] — > [n,m] be 
the function such that f n ,m{x) = x + 1 when x < m and / n , m (m) = n. We 
consider the classical measured structure ([n,m],E (1 [n, m], f n>m ) equipped 
with the counting measure and consider the corresponding AML structure 

Let (Y,A,T) be the ultraproduct of the 5DT njm 's with respect to some 
nonprincipal ultrafilter on N. Let B := <r(Def i(y)) and let ii be the canonical 
measure on B. It is clear from Los' theorem that (Y, B, fi, T) is a dynamical 
system. Next observe that, by our construction, = d(E). Now notice 

that, for any finite set of integers U, any rational 5 < iJ,(f] ieU T~ l A), and 
any N, we may find m, n such that m — n > N and 

\[n,m]nr\ ieU fn,L( En ^ m ])\ x 

> o. 



Txi — n 

Fix 7 > 0. Then for sufficiently large N, we also have that 
\[n,m]nr\ ieU (E-i) 



m — n 



> 5 - 7. 



Consequently, d(f] l€U (E - »)) > ^Ciieu T ' A )- D 
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5.2. The Regularity Lemma. In addition to the cr-algebras B n described 
above, it is useful to have certain sub-cr-algebras. 

Definition 5.4. Let 9Jt be an AML structure, let A C M be a set, let n be 
a positive integer, and let / C [l,n] be given. We define B^j(A) to be the 
Boolean algebra of subsets of M n of the form 

{(xi,...,x n ) £ M n :9Jt|=99(xi,...,x n )}, 

where (p is a formula with parameters from ^4 whose free variables belong to 
I. 

When k < n, we define £>° fc (A) to be the Boolean algebra generated by 
the algebras B^j(A) as I ranges over subsets of [l,n] of cardinality k. 

In all cases, we drop to indicate the u-algebra generated by the algebra. 
When A = 0, we omit it and write B n ^. 

These algebras were introduced, in a somewhat different context, by Tao 
in [291 M- 

Definition 5.5. Suppose that (G, E) is a finite (undirected) graph, U, U' C 
G are nonempty, and e is a positive real number. 

(1) We set d(U,U') == 

(2) We say that ?7 and J7' are e-regular if whenever V C £/, V' C V' are 
such that |V| > e\U\ and |V'| > e\U'\, then we have 

|d(^,t^)-d(v;v")| <e. 

Theorem 5.6 (Szemeredi's Regularity Lemma, |28J). For any k and any 

e > 0, there is a K > k such that whenever (G, E) is a finite graph, there 
is an n £ [k, K] and a partition G = U\ U • • • U U n such that, setting B = 
{(i,j) ■ Ui and Uj are not e-regular} , we have 



u 



Ui x U d 



<e\Gf 



Proof. For a contradiction, suppose the conclusion fails. Then we may find 
k,e such that for every K > k there is a finite graph (Gk,Ek) with no 
partition into at least k but at most K components satisfying the theorem. 
The partition of a graph into singleton elements consists entirely of e-regular 
pairs, so in particular \Gk\ > K for all K. 

Let Cq := {E}, where E is a binary predicate symbol. Inductively assume 
that AML signatures Cq C C\ C £ 2 Q • • • have been constructed. Then for 
any two AML £ ra -formulae <f(x) and vp(x), at least one of which does not 
belong to Ui"=i A> with only the displayed free variable, we add new unary 
predicates R^ix) and S ip ^(x) to C n +i- We let C := U^Li^n- We define 
finite measured /^-structures &k as follows: 

• The universe of <&k is Gk\ 

• The measures on &k are given by the counting measure; 
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• E is interpreted in &k by Ejc', and 

• Rtp^jS^ are interpreted by induction on formulas. Having in- 
terpreted ip,ip, we may set U = <p(Gk) and U' = iP(Gk)- If 



U, U' are not e-regular then set RJ^ 



s: 



Otherwise, 



choose V C U, V C {/' witnessing the failure of e-regularity and 



set R 



IS/ 



F and = V. 



^,■0 ~~ <,?,V> 

Let (6 be the ultraproduct of the ®k- We work in the canonical measure 
space on G 2 . From here on, we will identify formulae <p with their inter- 
pretation ip(G). Let h := H(xe I $2,1 )> the conditional expectation of \E 
with respect to the a-algebra -62,1- Since h can be approximated by simple 
functions, we may write 

h = Y a i*c t xD t + h! 

i<K 

where ||/i'||l2 < e 4 /4 and Ci,Di are definable. Let U±, U2, ■ ■ ■ , U n be the 
atoms of the finite algebra generated by {Cj} U {A}- Then we have 

h = VijXUixUj + h" 

i,j<n 

with 1 1 h" I \ L 2 < \\h'\\ L 2 and {Ui}i< n is a finite partition of G into definable 
sets. 

Let B be the collection of such that Rui,Uj (and therefore Su i: Uj) 

are non-empty, and for each £ B, define f3 itj = ^^'^ . By 

Los' theorem, for each (i, j) G 5, we have — ccjjl > e. Let 1? + C B be 
those (i, j) such that a^j — A,j > e - Suppose A*(U(jj)eB ^ x Uj) > e/2. We 
may assume M(U(i ^ x ^j) — e /4 (f° r otherwise we carry out a similar 

argument with B \ B + ). 

Again by Los' theorem, for each £ ^(Ru^Uj) > tn{Ui) and 

M%,t/ 3 ) > e/i(E/j). Set Z = U(ij)eB+(^i,^ x %^)- Note that z G $2,1 
and 



so we have 



/ h'xzdM = / ^ aijXf/ixC/.Xz - XEXzdn 



i,j<n 



,Uj) XEXRu ii jjj'xSv it u.d^ 



(i,j)eB+ 

£ 

(i,j)&B+ 
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(i,j)eB+ 

(i,j)eB+ 
> e 4 /4. 

But this is a contradiction, since f h'xzdfJ- < II^'IIlHIxzIIl 2 < e 4 /4 • 1. It 
follows that MU(jj)eB U * x U j) - e / 2 - 

Note that what we have constructed a partition of G which roughly sat- 
isfies the regularity conditions, but in the infinite model. Our final step is 
to pull this partition down to give a finite model, giving a contradiction. By 
choosing K > n large enough, we may ensure that the following hold: 

• Whenever B, R^ v . = 0, and therefore Ui{G K ) and Uj(G K ) 
are e-regular, 

• n{Ui{G K )) < y/2fi(Ui(G)) for each i. 
This implies that 

M ( (J u ^ G k) x U A G k) I < 2a* I (J Ui(G) x Uj(G) J < e 
\(<j')eB / \(<j)eB / 

as desired. □ 

Remark 5.7. The regularity lemma is usually stated with an additional re- 
quirement that the cardinalities of the partition pieces be nearly equal. This 
could be obtained with the following changes: for each integer n, include 
new unary predicates P n ,i, ■ ■ ■ , P n ,n in the language, and in the finite mod- 
els interpret these predicates as a partition into nearly equal pieces. Using 
these predicates, refine the partition {Ui} into one where the components 
have nearly the same measure. When we pull this down to the finite model, 
the sets will differ in size by a very small fraction (choosing parameters cor- 
rectly, this fraction can be arbitrarily small, say e 2 ), so we may redistribute 
a small number of points to make these pieces have exactly the same size 
without making much change to the edge density of large subsets. 

Remark 5.8. The method in this subsection extends very naturally to 
hypergraphs, using the algebras Bk^k-i hi place of 2?2,i. The details will be 
given in a future paper. 

6. The First-Order Translation and the Downward 
Lowenheim-Skolem Theorem 

There is a natural way to view an AML /^-structure as a classical structure 
in a language C* extending £ in a way that preserves the semantics. We 
define, by recursion, a chain C = Co C C\ C £ 2 Q ■ ■ ■ of signatures and a 
map ip(y) *->■ tp*(y) from classical £„-formulae to AML /^-formulae. If <p(y) 
is a classical C- formula, then set ip* := ip. Now suppose that this has been 
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carried out to stage n. Given an £ n -formula tp(x;y) and a term t E T a , we 
add |y|-ary predicates R V) t and S^t to £ n +l- We define 

{Rip,t(y)T ■= mg < t.tp*(x,y) and (S Vft (y))* := m £ < t.tp*(x,y). 

By denning (zb?/>)* := (V'l A V^)* := $f A f/'J, and (->il>)* := we 

can uniquely define tfi* for each £ n+ i-formula tp. 

Set £* := [] n C n . Observe that \C*\ = \C\ + N - Given an AML C- 
formula tp(x), one can define a classical C- formula tp*{x) by induction on the 
complexity of tp. First, define the rank of an AML /^-formula tp, denoted 
rk((/?), by induction: 

(1) If tp is a classical £-formula, then &(tp) = 0; 

(2) rk(-i</?) = rk(Vx<^) = rk(<^); 

(3) rk(</3 V tp) = max(rk(<^), ik(tp)); 

(4) rk(m^ ex r.ip(x, y)) = rk(</j) + 1. 

Now if rk(<^>) = 0, that is, if tp is a classical formula, set tp* := tp. Now given 
an AML £-formula tp of rank n, we inductively assume that tp* has been 
defined in such a way that tp* is a classical £ ra -formula. In this case, we 
set (mg < t.tp(x;y))* := Rp* t t(y), which is a classical £ n+ i-formula. One 
proceeds similarly with the constructor for < and the predicate S. One treats 
connectives and quantifiers as in the previous paragraph. Observe that if tp 
and tp are an AML £-formula and a classical £*-formula respectively, then 
ip = cp** and tp = tp**; observe also that the rank of tp* is equal to the least 
n such that tp is an jC n -formula. 

Now given an AML £-prestructure £DT, we consider the classical £*- 
structure A4* whose universe M is the same as the universe of 9JT and so 
that, for an £ n -formula tp(x;y), term t G T a , and a E M^, we have 

a E ^ 3PT |= mg < t.tp*(x, a). 

The following lemma is elementary. 

Lemma 6.1. Given an AML C-prestructure $Jt, AML C- formula tp{x), and 
a E M^l, we have 

OJl |= <p(3) ^ M* |= tp*(a). 

We now aim towards proving the following important model-theoretic 
fact: 

Theorem 6.2 (Downward Lowenheim-Skolem for AML). Given an AML 
C-structure 91 and A C N, there is an elementary substructure 9JI o/9t such 
that ACM and such that \M\ < max(\A\,\£\ + N )- 

We will use the first-order translation to prove the preceding theorem. 
First, by replacing 91 with its monotone closure, we may as well assume that 
91 satisfies the Monotonicity property (see Remark EHJ). Let M ] be an £*- 
elementary substructure of Af* containing A such that \M'\ < max(|yl|, |£| + 
Ho); this is possible by the Downward Lowenheim-Skolem theorem from first- 
order logic (see [6]) and the fact that \C*\ = \C\ + Hq. 
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The desired AML ^-structure will have universe M = Aft. We first 
make M into a £-prestructure TIq by setting B^° := for each r G Q-°. 
The specification of will be done through a sequence of modifications 
9Jto, SDTi , • • • The sequence will be constructed so that Tl n+ i is con- 
servative over Tl n with respect to formulae of rank < n. We define a 
modification Tli of 9Jt as follows: for any classical C- formula (p(x;y) and 
a € MM, we put {i e ll f l : TX \= (p{x,a)} G fig* 1 if and only if 
{x G iVl x l : |= ^(x, a)} G S^ r - It is clear that Tl\ is a conservative 
extension of Tlo with respect to classical formulae. 

Now suppose that n > and the sequence of modifications has been 
constructed up to Tl n -\. We now construct a modification Tl n of Tl n -i 
which is conservative with respect to formulae of rank < n — 1. If v?(x, y) is 
an £- formula of rank n — 1, we put {x G M : 91 |= <p(x, a)} G 23^™ if and 
only if: 

• {x G ATl^l : |= ¥>(x,a)} G B^ r 

• for every formula i^(x, z) of rank < n — 1 and every b G M' z ', when- 
ever {x G M : 9Jt n _i |= ip(x,b)} C {x G M : OT |= ¥>(x,a)}, we 
have {x G M : 9JT n _i |= ^(x,6)} G B^? -1 . 



Claim 1: 9Jt n is a conservative modification of 9JT n _i with respect to for- 
mulae of rank < n — 1. 

Proof of Claim 1: Clearly Tl n is a conservative modification of Tl n -\ 
with respect to formulae of rank 0. Now inductively assume that Tl n is a 
conservative modification of Tl n -\ with respect to formulae of rank at most 
m, where m < n — 1, and suppose that </?(x, y) has rank m. We must check 
that 

TX n |= ms 1x1 r.ip(x, a) <^ 9JT n -i |= n^x t< r.ip(x, a). 
First suppose that 9Jt n -i \= m x 1X1 r.<p(x, a), so 

{x G M : Tln-i |= </?(x,a)} G B^*" 1 . 

But the left-hand side of the display is {x G M : Tl n \= <f{x*,a)}, whence 
Win |= mg cxi r.ip(x, a). Now suppose that Tl n |= oo r.ip(x, a). Then 

{x G M : Tl n |= a)} G B^ r n . 
Without loss of generality, we may suppose that 

{x G M : Tl n \= a)} C {x G M : W\= rj>{2, b)} G B^?, 

where rk(tp) = n — 1. However, since rk(y?) = m < n — 1, by the choice of 

B™T, we have {x G M : |= a)} G B™^ 1 ■ This finishes the proof 

of Claim 1. 

We now make M into an £-prestructure Tl by setting B^ r := [j n £>^ r n . 
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Claim 2: For all formulae <p(x, y) and a 6 M, if rk((p) = k, then 9Jt |= </>(a) 
if and only if 9% \= ip(a). 

Proof of Claim 2: We prove this by induction on k. When k = 0, this is 
clear. Now suppose that this is true for k — 1, where k > 0, and suppose 
that y(x) = ix] r.ip(x,y), where rk(ip) = k — 1. First suppose that 

9Jt fe |= y?(a). Then {y G M : Wl k |= Y>(a,y)} G ^ C f^K. Since 9Jt fc 
is conservative over 93tfc-i with respect to formulae of rk < k — 1, we have 
that {y G M : 9JI fc |= Y>(a,y)} = {y G M : |= ^(a,y)}; by 

the induction hypothesis, we have {y G M : Wlk-i |= ip(a,y)} = {y G 
M : 9Jt |= ip(a,y)}. This shows that 9JT |= <p(a). Conversely, suppose that 
9J1 |= 93(a). Then {y G M : SOT ^= ^(a,y)} C B G £^ r . Without loss of 
generality, we may suppose that B G £> OTi , where I > k. By induction, we 
have {y G M : SEJt |= ip(a,y)} = {y G M : 9?l fc _i |= ip(a,y)}; since 9fy is 
conservative over SDT^— l with respect to formulae of rank < k — 1, we have 
{y G M : 9JT fc _i |= V(«,y)} = {y € M : DJt t \= ip(a,y)}- Thus, STOj |= p(a). 
Since StJtz is conservative over SPTfc with respect to formulae of rank < k, we 
have SDTfc |= (/3(a). This finishes the proof of Claim 2. 

Claim 3: For any formula <p{x) and any a G M, we have 

\=(p*(c?)<*M* \=^{a). (*) 

Proof of Claim 3: We prove this by induction on rk(^). First observe 
that if (*) holds, then 

m |= <p(a) 91 |= (p(a). (**) 

Thus proving (*) for all formulae if is sufficient to prove that 9JI is an 
elementary sub-prestructure of 91. Now if rk(<p) = 0, then (*) is clear. 
Suppose now that we know that (*) holds when rk(</?) < m and consider 
<p(x) = rritf < r.ip(x, y), where rk(?/>) = m. 

First suppose that Ai* \= ip*(a), so 9Jt |= m^ixi r.tp(a,y). Then 

{y G M : JOT |= ^(5, y)} C {y G M : 91 |= X (y,b)} G B^., 

where b G M and 91 |= ix r.\{y, b). By Claim 2, 

{y G M : 9Jt \= ip(a, y)} = {y G M : 9Jt fc |= ^(a, y)}. 

Suppose now that rk(%) < rk(-0). Then by the induction hypothesis and 
(**), we have 9Jt |= \/y(ip(a,y) — > %(y, 6)); since quantifiers and connectives 
do not increase rank, we have 91 |= \/y(ip(a,y) — > x(Vjb)) by another appli- 
cation of (**). It follows that 91 |= txi r.ip(a,y), that is, N* |= <p*(a), 
whence |= y*(a). Now suppose that rk(^) < rk(%). Then by the def- 
inition of B m , we have that {y G M : Wl \= ip(a,y)} G 2?^,, whence 
M* |= <^*(a) and hence \= <p*(a). 

Now suppose that |= (f*(a), so 91 |= < r.ip(a,y). Towards this 
end, we need to show that {x G : 9J1 |= ^(a,x)} G 6™ m+1 . We must 
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show that if x{V->z) nas rank < m and {y G M : 971 m |= x{Vi &)} != {y £ 
M : 91 |= ^(a,y)}, then {y £ M : 971 m |= x(y,6)} € 0^™. This is done 
by induction on rk(x). First suppose that rk(x) = 0. In this case, we have 
91 |= yy(x(y,b) -¥ ip(a,y)), so we have {x G M^l : 971 |= x(x,b)} G B™ 1 . 
We now proceed inductively. Suppose this is true for ranks < k and suppose 
that rk(x) = k + 1 < m. We still have {x G : 91 \= x(x,b)} G B^ r . 

Suppose that rk(x') < rk(x) and {y G M : SQt fc N= x'{y,c)} Q {y G M : 
91 H X(y ; &)}■ Then {y G M : 9JT fc |= X '(y, c)} C {y G M : 91 |= ^(y, a)}, 
so by the induction hypothesis, we have {y G M : 971 m |= x' £ £>® T r m . 
Thus, we have {y G M : 971 m |= x(y, &)} G i3^ r m . This finishes the proof of 
Claim 3. 



An extremely useful consequence of the elementarity of 971 in 91 is the 
following: Given a formula v?(x, y) and a G M, we have {x G Ml x l : 
971 |= <p{x,a)} G Bg£ if and only if {x G : 91 |= y>(x,a)} G fl*-. 

One proves this result by induction on the rank of cp. Equipped with this 
fact, it is easy to verify that 971 is an AML structure. For example, to see 
that 971 satisfies the first half of the Finite Additivity property, suppose 
that {x G M^l : 971 |= ^(f,al)} G B%., i = 1,2, and let r := n + r 2 . 
Then we have G : 01 |= ^(f,al)} G B^ r ., for t = 1,2; since 91 

is an AML structure satisfying the Monotonicity property, we have that 
{x G NW : 91 |= y»i(x,oi) V ^(£,02)} G £< r - By our observation, we see 
that {x G Ml^l : 071 |= </?i(x, al) V ^(s?, a^)} G -Bf 1 ,,. 

This finishes the proof of Theorem 16.21 □ 



7. Model Theory and Applications 

7.1. More Model Theory. We introduce some standard (and less stan- 
dard) notions from model theory. We often discuss the case where the 
language is countable, 971 is Ni-saturated, and we consider a countable sub- 
structure, since this is the most interesting case for our purposes. Most of 
these results would still hold as long as the saturation of 971 is greater than 
the cardinality of either the signature or the submodels we consider. 

From now on, we fix a countable signature C and a measured /^-structure 
971 (although Lemmas 17, 11} 17.101 and 17.131 below make no mention of the 
measure and thus these Lemmas go through for an arbitrary /^-structure). 
For example, 971 could be a Fubini structure equipped with its canonical 
measures. Also, for sake of readability, we will write jx for the measure, 
regardless of the cartesian power of M n under discussion. Finally, we will 
often identify a formula (f(x) with parameters from M with the subset of 
M n that it defines; in this way, we may write fj,(<p) to denote the measure 
of the definable subset of M n defined by ip. Likewise, we may write —>Y to 
indicate the complement of the definable set Y. 
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Definition 7.1. Suppose A C M. 

(1) A partial type of n-tuples (or an n-type) over A is a collection 

of formulae with parameters from A, where X — (%\ ; • • • ; •Kn)i SUch 
that for every tpi, . . . , ip n £ p, there is a £ M n such that 9Jt |= (fi(a) 
for every i <n. 

(2) A partial type p is said to be a over A if for every formula (f> 
with suitable free variables and parameters from A, either <f> £ p or 

(3) A global type is a type over M. 

(4) If a is a sequence of elements, we write tp(a/^4) for the set of formulas 
with parameters from A satisfied by a. 

(5) If 9Jt is measured, then the partial type p is wide if for every ip € p, 
H(<p) > 0. 

Remark 7.2. An ^-structure Wl is ^i-saturated if and only if, whenever 
A Q M is countable and p(x) is a partial type over A, there is a £ Ml 2 ! such 
that 9Jt |= 99(a) for all <p £ p. In this case, we write a \= p. 

Lemma 7.3. Suppose that A C M is countable. Then for almost every a, 
tp(a/A) is wide. 

Proof. Any a such that tp(a/A) is not wide must belong to some set of 
measure definable with parameters from A. There are countably many 
such sets, so their union has measure 0. □ 

Lemma 7.4. Suppose that A C M is countable. Then for almost every 
(a,b), tp(a/MU{6}) and tp(fe/M U {a}) are both wide. 

Proof. By the previous lemma, for each b the set 

Tg = {a : tp(a/M U {6}) is not wide} 

has measure 0. Therefore n({(a,b) : a £ Tg}) = / fi(T^)d^(b) = 0, so 
the set of (a,b) such that tp(a/M U {&}) is not wide has measure 0. By a 
symmetric argument, also the set of (a, b) such that tp(6/M U {a}) is not 
wide has measure 0. Therefore almost every (a, b) is in neither of these sets; 
for such (a, 6), tp(a/M U {6}) and tp(6/M U {a}) are both wide. □ 

Definition 7.5. Suppose that (pi : % £ I) is a sequence of r-tuples of 
elements of M, where / is an intial segment of N, and A C M. Then (pi) 
is a sequence of indiscernibles over A if whenever <j>(xo, . . . , x n ) is a formula 
with parameters from A and the displayed variables and uiq < • • • < m n , 
we have 

Wl |= 0(6 O , . . . , 6 n ) O (f)(b mo , ...,b mn ). 

That is, for every n there is a type p n of r ■ (n + l)-tuples such that 
tp(b mo , . . . ,b mn /M) = p n whenever mo < ••• < m n is an increasing se- 
quence. 
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7.2. Amalgamation. The arguments in this section are essentially derived 
from |21| . 

Lemma 7.6. Suppose that n(M) is finite, (bi) is a sequence of indiscernibles 
over A C M, X is a definable set over A, and n(X^) > holds. Then for 
any n, /i(f|i<„ X^) > 0. 

Proof. Suppose the conclusion of the lemma is false and take k > minimal 
so that KfVfc-XSj) = °- For n> k—1, let C n = f] i<k ^ X g . n X^. Then 
/J,(C n ) = M(rii<fe-i Xr.) > by indiscernibility. However, when k — 1 < 
n < m, by indiscernibility again, /u(C n n C m ) = n(f] i<k X? ) = 0. This is a 
contradiction since fi is a finite measure. □ 

Lemma 7.7. Suppose that 9Jt is ^i- saturated, [i(M) is finite, and A C M is 
countable. If (bi) is a sequence of indiscernibles over A and tp(a/A U {bo}) 
is wide, then for any n, there is an a' with tp(a', bi/A) = tp(a, bo/ A) for all 
i < n. 

Proof. Let X be a set definable over A and suppose (a, bo) £ X. Then 
a £ X^ o and, since tp(a/A U {bo}) is wide, fi(X^ Q ) > 0. By the previous 
lemma, fi(f} i<n X^ ) > 0, and is therefore non-empty. By ^i-saturation, 
there is an a' such that a' £ C\ i<n X-g simultaneously for all X 3 (a, &o) that 
are definable over A. Therefore tp(a', bi/A) = tp(a, bo/A) for all i < n. □ 

Remark 7.8. The previous lemma suggests a connection between wideness 
and the model-theoretic notion of nonforking, as we now explain. First, a 
formula <p(x,b) k- divides over a set A C M if there is a sequence N) 
which is indiscernible over A for which bo = b and such that f(M, bi) = 
for any / C N with |/| = k. We say that <p(x,b) divides over A if it /c- 
divides over A for some k > 2. We say that ip(x,b) forks over ^4 if there 
are formulae ipi(x, b±), . . . , il> n (x, b n ) such that <£>(M, 6) C |J" =1 ipi(M, bi) and 
such that each V'iC^) divides over A. Finally, we say that a type p(x) forks 
over A if it contains a formula which forks over A. In model theory, when 
tp(a/A U {6}) does not fork over A, this implies that a is in some sense 
independent from b over A. For example, when working in an algebraically 
closed field K and k is a subfield of if, then tp(a/k U {6}) does not fork 
over k if and only if, whenever a is a generic point for a Zariski closed set V 
defined over k, then a does not lie in any Zariski closed set V defined over 
k(b) with dim(V') < dim(y). Lemma 17.71 shows that if A C M is countable 
and tp(a/^4 U {b}) is wide, then tp(a/^4 U {b}) does not fork over A. 

Definition 7.9. Suppose that A C M and p is a global type. 

(1) p is A-invariant if whenever tp(ai, . . . , a n /A) = tp(a' 1 , . . . , a' n /A), 
we have X Sl) ... jSn £p» ^.....s; G P- 

(2) p is A-finitely satisfiable if whenever X £ p, X n vl 7^ 0. 
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Lemma 7.10. Suppose that p is a global type and A C M. If p is A-finitely 
satisfiable then p is A-invariant. 

Proof. Suppose not; then there are definable X and a\, . . . ,a n ,a[, . . . , a' n so 
that -^ai,...,S„ £ P an d Xff t ff n p. Since p is a global type, this means 
_l ^"s' 1 ,...,a^ ^ an< i since p is closed under intersections, -^ai,...,a„ V-^si,...,^, £ 
p. But then there is an element m £ A such that m G -Xgi,...,a„ \ -X'a' ..,a{,> 
contradicting the fact that tp(ai, . . . , a n /A) = tp(a' 1; . . . , a' n /A). □ 

Lemma 7.11. Let 9T be an elementary substructure of 9JI. If p is a type 
over N, then there is an extension of p to a global N -finitely satisfiable (and 
therefore N -invariant) type. 

Proof. Note that, since 91 is an elementary submodel of Wl, each X G p has 
the property that X n N n / 0. Let 

p' =plj {^Y : Y G Def n (M) and Y n N n = 0}. 

We will show that every finite subset of p' is satisfied by an element of 
N. If not, there is an X G p and Yi,...,Y n with Yj fl TV = such that 
Xnf] i ^Y i = $. SoIniVfl HiPi U -Y;) + 0, and since each Y; n TV = 0, 

Let g be an arbitrary extension of p' to a (global) type. Suppose q is not 
finitely satisfiable in M; then there is a Y G g with Y n iV = 0, which is 
impossible since then -Y £ p' Q q. □ 

Definition 7.12. If S 1 is a set and p a global type, write p : £ for the 
restriction of p to sets definable over S. 

Lemma 7.13. Suppose p is a global A-invariant type, and recursively choose 
b n \= p : A U {bi}i <n . Then (bi) (if it exists) is a sequence of indiscernibles 
over A. (This sequence always exists iftfft is Hi- saturated.) 

Proof. By induction on n, we show tp(6 mo , . . . , b mn /A) is constant whenever 
rriQ < • • • < m n . When n = 1, this follows since each tp(bi/A) = p : A. 
Suppose now that b n , ...,bo)EX. Then also (b mn+1 ,b n ,...,bo) G X 

holds because tp(b rrin+1 /A U {6 , . . . , b n }) = tp(b n+1 /A U {6 , . . . , b n }) = p : 
Au{bo, . . . , b n }. By the induction hypothesis, we have that tp(£>0j ■ • • , b n /A) = 

tp(6 mn , . . . , b mn /A). Since Xr ? G p. also Xr ? G p, whence we have 

u o n ,...,oo o mn ,...,o mt) 

(&m„+u &m n , • • • , frm ) £ ^ 

Lemma 7.14. Suppose that 9Jt is ^i-saturated and /jl(M) is finite. Suppose 
that A C M is countable, q is an A-invariant type, b \= q : A U {a}, 
tp(6'/A) = tp(6/A) ; tp(a'/A) = tp(o/A), tp^/AU {6}) is wide, X,Y are 
definable with parameters from A, and fi(X^nY^) > 0. Then n(XtfP\Yp) > 0. 
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Proof. Suppose the claim fails, so ^(XgiDYr,) = 0. By Ni-saturation and the 
fact that tp(b'/A) = tp(b/A), there an 3" with tp(a", b/A) = tp(S' , b'/A); in 
this way, we may assume 6 = 6'. 

Claim: There is e > so that whenever 3* \= tp(3/A) and b* \= q : Au{3*}, 
tM(X d *nY^)>e. 

Proof of Claim: Suppose the claim is false. Let p = tp(a/^4). Then the 
partial type 

p(x)U{<p(x,y) : (f(a, y) G q\A U {a}} U {[i(X x n Y y ) < — : n > 1} 

n 

is finitely satisfiable (and hence satisfiable by ^i-saturation). Indeed, given 
n > 1, we can find a* |= tp(3/A) and 6* |= tp(b/A U {a*}) such that 
[i{Xfi* n < — ; it follows from ^4-invariance of q that if ip(3,y) G g|^4 U 
{a}, then ip{3*,y) G g|j4 U {a*}, whence 9Jt |= (p(3*,b*). We thus have 
a* |= tp(a/A) and 6* |= tp(6/A U {3} such that /u(JT s * n Yg,) = 0; since 
tp(a, = tp(a*, 6*/^4), we get fi(Xg n Yg) = 0, which is a contradiction. 
This proves the claim. 

Choose So \= p and 6o 1= q : AU {So}. Let {3i,bi}i< n be given so that 
(6j) is indiscernible over A For each 5 > and each C G tp(a/^4), by the 
wideness of tp(a'/j4 U {6}), we have 

fi{Cn{x : 9Jt h (m 2 < S.X(z, x) A Y(z, 6)) }) > 0, 

and therefore by Lemma 17.71 and ^i-saturation we may find an a n +i with 
tp(S n+ i/A) = tp(a/^4) such that n(Xg n+1 PlYg .) = for i < n. Let 6 n+ i 1= q \ 

(Au{3i, 6j}j< n U{a n+ i}); by Lemma 17. 131 we have ensured that (6j) remains 
indiscernible over A. For each i, let Ci = A^. n B? . Since each b n \= q \ S n , 
fJ-(Ci) > e; while for i 7^ j, /i(Cj n Cj) = 0. This is a contradiction to the 
finiteness of n[M). □ 

Lemma 7.15. Suppose that SO? is ^i-saturated and (jl(M) is finite. Suppose 
that A C M is countable, q is an A-invariant type, b t= q : A L) {a}, 
tp(b'/A) = tp(b/A), tp(3'/A) = tp{3/A), tp(a'/Au{b}) is wide, X,Y are 
definable with parameters from A, and and n(X^ n Yr) = 0. Then fJ>(X^i n 
Y p ) = 0. 

Proof. Suppose the claim fails, so n(Xg/ D Yg>) > 0. As in the proof of 

the previous lemma, we may assume that 6 = 6'. Suppose that {3i,bi}i <n 
has been constructed (including the empty case where n = 0) so that Si \= 
tp{S/A) for each i and so that (foj) is indiscernible over A. Choose b n \= q : 
A U {Si, bi}i <n . There is some e G Q >0 such that for each C G tp(S/A), 

H(C n{x : Wl N (mg > e.X(z, x) A Y(z, b)) }) > 0, 
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and therefore by Lemma 17.71 and Ni-saturation we may find an a n with 
tp(a n /A) = tp(a/A) such that n{Xa n H Y"^) > e for i < n. For each i, let 
d = X$. n Yg . Then fi(Ci) > e for each i and, when i < j, fi{Ci n Cj) = 
since bj \= q : AL) {Si}. Thus (J,(Xg. n lg ) = by A-invariance. This 
contradicts the fact that (J,(M) is finite. □ 

Theorem 7.16. Suppose 9Jt is ^i-saturated and is finite. Let 91 6e 

a countable elementary substructure of 9JT. Let p, g 6e types over TV and 
suppose tp{a/N) = tp(a'/iV) = p, tp(b/N) = tp(b'/N) = q with tp(a/N U 
{b}), tp(a'/NU {&'}) wide. Then for any definable sets X andY over N , we 

have n(x s n y ? ) > o iff fi(Xg, n y ?; ) > o. 

Proof. Fix an extension q' of g to an AMnvariant global type; this is possible 
by Lemma E33J Let a* N p and b* t= g' : JV U {a*}. If //(X 3 * nij,)>0 
then by Lemma ITTH both fi(X s C]Y^) > and //(Xg/Dyp) > 0. Otherwise, 
[i(X$,r\Yfr) = 0, and by Lemma[7ZE5l both /j,(X s DY^) = and /i(X a /nr 6 /) = 
0. " " □ 

Definition 7.17. Let 9T be an elementary substructure of 9Jt. A set R C 
M 2m is wide-stable over 91 if i? is iV-invariant and whenever tp(o/A r ) = 
tp(a'/iV), tp(b/N) = tp(6'/iV), both tp(a/iV U {&}) and tp(a'/N U {&'}) are 
wide, and (a, b) G ii, then also (a', 6') G -R. 

i? is stable over 91 if whenever (aj, 6j) is a sequence of indiscernibles over 
N and R(a*i, bj) holds for every i < j, also R(Sj, bi) for some i < j. 

We say G ^(iV) is approximated by definable stable sets (ADS) (re- 
spectively, approximated by definable wide-stable sets (ADWS)) over iV if 
for every e > 0, there is a stable (respectively, wide-stable) set S definable 
over N such that fi(RAS) < e. 

Observe that the wide-stable subsets of M 2m form a cr-algebra. It can 
be shown that stable subsets of M 2m form a Boolean algebra. Note that 
if we replace wideness in the definition of wide-stability with non-forking, 
we obtain a standard consequence of stability (see Lemma 3.3 of [25]). In 
particular, since wide types are non-forking, stable implies wide-stable. 

Theorem 7.18. Let SUt be Ni- saturated, let 9t be a countable elementary 
substructure of 9Jt, and suppose \i is finite. If R C M 2 is in ^(iV), then 
the following are equivalent: 

(1) There is U G B 2 ,i(N) such that fi(RAU) = 0; 

(2) R is ADS; 

(3) R is ADWS. 

Proof. (1) (2): First observe that every set of the form Ax B with A, 
definable over N, is stable: if (ai,bi : i G /) is a sequence of indiscernibles 
over iV and (aj, bj) £ A x B for i < j then (aj, &j) G A x B for all i < j. 
Consequently, the algebra generated by the sets of the form A x B, with A, B 
definable over N, which is dense in B2,i(N), is contained in the algebra of 
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stable subsets of M 2 . Thus, if there is U G B 2 ,i(N) such that fi(RAU) = 0, 
then for every e > 0, there is S G £>r>,i (N) such that fi(RAS) < e; such an 
S is stable. 

(2) =^ (3): Immediate since stable definable sets are wide-stable and 
definable. 

(3) =^ (1): Let R C M 2 be definable over iV and wide-stable over N. Since 
2?2,i(-^0 is complete with respect to the pseudometric /i(-A-), it suffices to 
prove (1) for such an R. For any iV-definable A and B and any e > 0, define 
Af = {a G A :WX\=m y < e.B \ R a }. Set 

U = {AxB : n({AxB)\R) = 0, A,B € fii(Af)}U{^|(^f /n xS) : A,B£ &i{N)}. 

n 

Clearly U = \JU belongs to B 2 ,i(N) and satisfies ^([7 \ R) = 0. 

Suppose, towards a contradiction, that \ [/) > 0. Then we may 
find an (a, 6) £ R\U such that tp(a/iV) and tp(6/iV U {a}) are wide. For 
each A G tp(a/N) and B G tp(b/N), we have A x B g U, and therefore 
xB)\JJ)>0. Therefore p = (tp(a/iV) x tp(6/iV)) U {^R(x,y)} is a 
wide partial type. Set 

p'=pU {^S(x, y) : (Ve G Q >0 )(m„ < e.S(x, y) G p)}. 

We claim this is also a wide partial type. Towards this end, fix A and B 
definable over N such that a G A and b £ B. Also fix S*(x, y) definable over 
N so that, for each e G Q >0 , m y < e.S(x,y) G p. Since (a,b) ^ £/, we have 
some e G Q >0 such that Af tp(a/iV). Set 

A' = {a' £ A : <M\= (m y > e.(B \ R a ,)) A (m y < e.S(a', y))}. 

Observe that A' G tp(a/iV), whence fi(A') > 0. It is enough to show that 
fi((A' x B) n (-ii?n -.S 1 )) > 0. Suppose this is not the case. Then 

H((A' xB)\R = n((A' x B) n (S \ R)). 

However, 

n((A' x B)\R) = [ ix{B \ R a ,)d» > efi(A') 

Ja'eA' 

while 

H{{A' x B) n (S \ R)) = [ ii{Bn{S a ,\R a ,))dii<en{A'), 

Ja'eA 1 

yielding a contradiction. 

Now take any extension of p' to a wide type q and suppose that (a 1 , b') 
realizes q. It follows immediately that tp(b'/N U {a'}) is wide, tp(a'/N) = 
tp(a/N), andtp(b'/N) = tp(b/N). Since tp(b/NU{a}) is wide and tp(a'/N) = 
tp(a/N), whenever B a G tp(b/NL){a}), fi(B a /) > 0. By Hi-saturation, there 
is a b" with tp(b"/N U {a'}) = tp(b/N U {a}). But now we have (a', b') G" i? 
and (a', b") G i?, contradicting wide-stability. □ 
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We could generalize these notions to stable relations on pairs of ra-tuples, 
by using the two algebras 2 „ n in i an d &2n,[n+l,2n] (the algebras of sets of 
2n-tuples depending only on the first n or only on the second n coordinates, 
respectively); the arguments are exactly analogous, replacing the singletons 
with n-tuples. 

Combining Theorem 17.161 and the proof of the previous theorem, we see: 

Corollary 7.19. Suppose 9Jt is Hi - saturated and n{M) is finite. Suppose 
that y\ is a countable elementary substructure of and that X and Y are 
definable over N . Then {{a,b) : fJ>(X a n !&) > 0} differs from an element 
of £>2,i by a null set. 



7.3. Triangle Removal. We now give a proof of the triangle removal lemma 
for graphs [27], a natural application of these methods since it was one of 
the original applications of Szemeredi's regularity lemma. The proof here 
is related to the infinitary proof (of the full hypergraph removal theorem) 
given by Tao [29J in a different framework. With a bit more effort, this proof 
also extends to hypergraphs (see |32j). 

Suppose B is the cr-algebra generated by some collection of formulas with 
parameters from an elementary substructure 9JT of 0T. Two natural ways to 
extend B would be by extending the collection of formulas and by extending 
the set M. The following lemma states that these two methods are orthog- 
onal in a certain sense. This lemma will be applied in the particular case of 
the algebras #2,1 (M), Z?2,i(M U {a}), and ^(M) (as defined in Definition 
15 .4]) . and the reader will not be mislead assuming these are the algebras 
used. (Recall our notation that B° is the Boolean algebra of definable sets 
generating the algebra B.) 

Lemma 7.20. Let $ be a set of formulas, let 9JT be an elementary substruc- 
ture of VI, and let n be an integer. Suppose A is the collection of sets of the 
form (p(N n ,a) where 4>{x,y) G <3? and a G M^, B° is the set of M -definable 
sets of n-tuples in 91, and C° is the collection of sets of the form cj)(N n ,a) 
where cf>(x,y) G <!> and a G N^. 

Then for any f G L 2 (B), ||E(/ | A) - E(/ | C)\\ L 2 = 0. 

Proof. Suppose not. Then setting e := ||/ — E(/ | »4)||i,2 and 5 := 
\\f — E(/ I C)||z,2, we must have 5 < e. Since / is immeasurable, for 
some (3 m , some ipi,..., ip m , and some bi,...,b m in M, we have 

Wf-Ti< m PiX^(x,bi)\\^ <(e-*)/4. 

Since || / — E(/ | C)\ = 5, there are ai, . . . , formulas fa, . . . , (j>k G 

and di,...,d k in N such that ||/ - ^< fe atiX^x, dj)lli 2 < e - 3(e - 5)/4, 



Hrushovski has pointed out that this proof is reminiscent of early proofs in the stability 
theory of algebraically closed fields. The full connection between this argument and the 
amalgamation methods from the previous section is not completely understood. 
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and therefore 

II ^2 PiXfiixA) - ^OiiX^ix^di)^ < e - (e - S)/2. 

i<m i<k 

This is not itself a formula, but we can construct a formula which corre- 
sponds to it. 

Squaring both sides and expanding the product, we have 
(e- (e-5)/2) 2 > J Eij< m PiPjXto h) X ^ (x, bj) 

-2 / J2i< m ,j<k Pi a jXiPi (x, bi)X4> 3 di) 
+ / Eij<* atiOijXtoix, di)x4> 3 dj). 

For each i < m,j < k,we may choose an such that f x^. (x, bi)x<t>j (x, di)dp < 
Tij and for each i, j < A; we may choose an Sjj such that f Xfa (x, di)x4>j (x, di)dp < 
sij, and we may choose these so that 

(e - (e - 5)/2) 2 > J ^ f3if3 jX ^(x, bi)x^(x, bj)-2 r ij Ao! ? + ^ s^o,-. 

Now let . . . , 6 m , di, . . . , d&) be the formula 

y\ mj< rij.(pi(x, bi) A ^-(x, d,) A /\ m s < r^-ip^x, di) A ^-(z, d,-). 

i<m,j<k *>i<fe 

Since 91 |= p(6i, . . . ,b m ,di, . . .,d k ), we have 01 |= 3yi, . . .,y k p(bi, 

"mi Dli ■ ■ ■ iDk)- 

By the elementarity of 50?, there exist d[,...,d' k in M such that Wl |= 

p(b\, . . . , b m , d\, . . . , cH k ). Consequently, for each i < m,j < k, we have 

/ X^i {x, bi)X4>j & d'^dp < nj and for each i, j < k, we have / Xfr (x, 4)x«^ (x, d'^dp < 
s^. Therefore 

II ^PiXti&bd-^OiXto&dblltf <e - (e-d)/2 

i<m i<k 

and 

11/ -^aix<i*{x,£i)\\v < e - (e - <5)/4. 

Since E«<fc c^iX^j dj is measurable with respect to „4, this contradicts the 
assumption that || / — E(f \ A)\\l2 = e. □ 

The following theorem is essentially the infinitary version of triangle re- 
moval: if Ai,A2,A$ are sets of pairs, viewed as the sets of edges which 
could make up the legs of a triangle, and whenever we remove definable 
sets from each group of edges, we still leave a triangle, then the set of tri- 
angles has positive measure. We will want to think of sets of pairs, like 
Ai, A2, A$, as sets of triples depending only on two coordinates. For the 
remainder of this section, if C is a set of pairs and 1 < i < j < 3, write 
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C* J = {(xi,X2,xs) | (xi,Xj) G C}. Similarly, if / is a function on N 2 , let 
X2, 23) = f(xi,Xj). (In what follows, we will almost exclusively be 
concerned with A} 2 , A}, 3 , and A 23 , or with functions derived from these sets.) 

Theorem 7.21. Let A\,A2,A 3 £ ^(M) where VJl is an elementary sub- 
structure ofyi, and suppose that there is a 5 > so that whenever B±,B2, B3 
are definable and [J?{Ai \ Bi) < 5 for each i < 3, we have B\ 2 n B\ 3 D B 23 
is non-empty. Then fi 3 (A\ 2 n A\ 3 n A3 3 ) > 0. 

Proof. First, observe that 

M 3 (^l 2 n ^ 3 n A 23 ) = III XAfXAfXAfdfi 3 



J f XMXA^XAf dn 2 (x!,x 2 )j dfi(x 3 ). 



Let us define gi = E(xa; \ #2,1 (M)). For any fixed x 3 , Xa^ an d XAf> are 
2?2,i(MU {x3})-measurable, so we have 

J f XA l XA 1 2 3 XAfdfi 2 (x 1 ,x 2 ) = j j E(xa x I B 2 ,i(M U {x 3 }))xA^XAfdfi 2 (x 1 ,x 2 ) 



II 



9iXA^XAf d n 2 (x 1 ,x 2 ) 



by the preceding lemma. Since this holds for every x 3 , we have 

.3/ a12 r-, a13 r> /|23\ f f f 12.., ...3 



^{A? n A? n Af) = JJJ g^xAfXAfd^ 

We can now repeat this, applying it to A2 and A3 (note that this argument 
only used that xa 2 j XA 3 were measurable — their definability was not used — 
so the same argument goes through with g\ 2 replacing XAi), whence we 
have 

AA 2 n A? n A 23 ) = HI gfgfgfd^ 3 . 



Let Ai = {{a,b) \ gi(a,b) > 0}. It will suffice to show that fi 3 (A\ 2 n Af 1 n 
if) > 0. Note that fi 2 (Ai \ Ai) = 0. 

Fix a finite algebra T> C B^^M) such that, for each i < 3, we have 

(Unsurprisingly, there is some resemblance to the infinitary proof of the 
regularity lemma.) Note that 

y Q > J (x Al ~ E( XAi I ^)) 2 ^ > (1 - |) V(4 \ Ai), 

whence fi 2 (Ai \ Ai) < 5 and therefore (i 2 (Ai \ Ai) < 5. 

Since T> is finite, it is atomic and the definable sets Ai must have the form 
\Jj< ni (Cj : i x Dj : i), where the Cjj, Dj^ are atoms of V. By removing a set of 
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measure 0, we may assume that fj,(Cj ; i), fi(Dj ; i) > 0. By assumption, there 
is an (x, y, z) G A\ 2 n A^ 3 n A3 3 . This means that, for some j\ , h , jz , we have 
(x,y) G C ju i x (z,z) G Cj 2)2 x Dj 2 ,2, and (y,z) G C i3i3 x £> j3i3 . Since 

these are all atoms, we have Cj u i = Cj 2)2 , D^ i = Cj 3 s, and Dj 2t 2 = Dj 3 s, 
and C ju i xC j3:3 xD hj2 C ij 2 ni^ 3 nif. In particular, /i 3 (i} 2 ni^ 3 nif) > 
0. 

Note that 

» 3 ((A 1 \A 1 ) 12 nA?nAf) = fff x^i 1 ~ x A ?)xA?XA? d » 3 

XAl^-Hx Al \^)) 12 XAfXAfd^ 

= 1 r (A?nA?nAf). 

The same argument applies to A2 \ A2 and A3 \ A3, so 

/x 3 (i} 2 n Af n i| 3 ) > n 3 ((A\ 2 n if) n (A* 3 n A* 3 ) n (Af n i| 3 )) 

>^ 1 2 ni 2 3 ni| 3 ) 
>o, 

finishing the proof of the theorem. □ 

Corollary 7.22. For each e > 0, there is a 5 > such that whenever (G, E) 
is a graph with at most 5\G\ 3 triangles, it is possible to remove at most e\G\ 2 
edges to obtain a triangle-free graph. 

Proof. Suppose not. Then for some e and each K, there is a graph (Gk,Ek) 
with at most \G\ 3 /K triangles such that every subgraph with at least \Ek\ — 
€\Gk\ 2 edges contains a triangle. 

We consider a signature of AML consisting of a binary predicate E. We 
consider finite measured structures WIk defined as follows: 

• The universe of 9JXk is Gk, 

• The measures on Tlx are given by the counting measure, 

• E is interpreted by Ek- 

Let 9JE be a (nonprincipal) ultraproduct of these structures. Note that, in 
9Jt, we have fJ>(E 12 n -E 13 n -E 23 ) = 0. By the preceding theorem, we can 
find definable sets B\,B2,B% such that ^i 2 {E\B,j) < e/3 for each i < 3 
and B\ 2 n B\ 3 n B 23 = 0. Note that saying this intersection of definable 
sets is empty is expressed by a single formula, and is therefore true for most 
of the structures (Gk,Ek). But then, for some K, (Gk,Ek H B\(Gk) H 
B2{Gk) n Bs(Gk)) is a triangle- free subgraph obtained by removing fewer 
than e\Gx\ 2 triangles, yielding a contradiction. □ 
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7.4. Gowers Norms. 

Definition 7.23. Let G be a finite abelian group and consider g : G — > R. 
We define the k-th Gowers uniformity norm, \ \ ■ \ \jjk, by 

IM& = ]^ifc+rE S II g{x + "-h). 

It is not immediate that the right-hand side of the above display is nonneg- 
ative; however, this can be derived using an argument similar to that in the 
proof of Lemma 17.261 below. 

The Gowers norms were introduced by Gowers in his proof of Szemeredi's 
Theorem [15J. Since then, the norms have proven to be powerful tools in 
combinatorics; for instance, these norms have been used to give a proof of 
the hypergraph regularity lemma [TB] and in the proof of the Green- Tao 
theorem on arithmetic progressions in the primes [18] . Related norms for 
dynamical systems, the Gowers-Host-Kra norms, we introduced by Host 
and Kra [20] . and have similarly been used to prove recurrence theorems in 
dynamical systems (for a few examples, see [21 [8]; [H] describes the general 
method and cites more than twenty examples). 

Roughly speaking, the U 2 norm is large when a function has a large 
correlation with some group character. The U k norms for larger k are large 
when a function correlates with a canonical function of a more general type. 
The exact characterization of these canonical functions was a substantial 
project [171 119] - Here we show that, in the setting of AML, these canonical 
functions can be taken to be the simple functions generated by algebras 
#fc,fc-i- 

In the infinite setting, we give a slightly more general definition: 

Definition 7.24. Let 9Jt be a measured AML structure and let / : M k — > R 
be bounded and ^.-measurable. Define II • \ \jjk by: 

w£{0,l} fc 

Suppose further that + is a definable group operation on M and g : M — > R 
is bounded. Then define / : M k — > R by f(h\, . . . , h^) = g(J2i=i hi) an d 
define I^H^ := ||/||r/^. 

Note that in the infinite setting, these are seminorms (and not even a semi- 
norm for k = 1). 

Lemma 7.25. Let (Gj : n G N) be a sequence of finite abelian groups viewed 
as classicaly measured structures with the counting measure and let &i be 
the AML structure associated with G{. For each i, let gi : Gi —> [— 1, 1] be a 
function such that limj_ s . 0O ||<?i||;yfc exists. LetU be a nonprincipal ultrafilter 
on N, let & := \\ u <5 n , and let g : G — >■ [—1, 1] be the ultraproduct of (gi). 
Then\\g\\ V k = lim^oo Hftllc/fe- 



36 ISAAC GOLDBRING AND HENRY TOWSNER 

Proof. First observe that 



I ll 2fe 
\9i I I JJk 



1 



\2k 



e n »(E« 



which is easily seen by making the substitutions x = J2i ^? an d ^« = ~ ^H- 
Define * : G k Gf by = (E^ W : w G {0, l} fc ); observe that &) 
is uniformly definable in (5$. Now define ^ : Gf — )• [— 1, 1] by g'^x^)) = 
Ilwg{o i} fc 9i( x u)- Then the lemma follows from Theorem 14.141 (applied to 
(g'j) and (ji)) and the remark following it. □ 

For the rest of this subsection, we fix / : M — > K which is bounded and 
i3fc-measurable. We further assume that each /i k is a probability measure on 



Lemma 7.26. 



fdfi k 



< 



u k 



Proof. Using Fubini's theorem, we have 



f(hW k (h) 



f{h)dn{h k ) ) d/" 1 ^!, 



fc-i, 



By Cauchy-Schwarz and Fubini again, we have 

2 k 



f(h)dfi h (h) 



< 



{^j f(h\, h k -i,hl)f(hi, ... , h k -i, h 



lw k+l 



Repeating this process, we arrive at 



f(hW k (h) 



2 k 



< 



u<={0,l} k 
U k ' 



□ 



Lemma 7.27. For each I C [1, k] with \I\ = k — 1, let Bj be a definable set 
in B k j. Then < \\fUi XbAIu^, < \\f\\u k - 



Proof. It suffices to show that < H/XB/llt/fc < 1 1 /lit/* f° r a single /. 
Without loss of generality, we assume I = [1, k— 1]. Since / = fxBj + Jx~b~i 
we have 

1 1 /II ir* = WfXBj +fXm\\uk 
which in turn expands into a sum of 2 terms of the form 



/ 



uj£{0,l} k 
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where each is either x_B/ or Xw Observe that ||/||r /fc corresponds to the 

ok 

term when each = xb^ Thus, it suffices to show that all of the 2 terms 
are non-negative. 

Observe that if co(i) = for each i € / but S w 7^ S^ 1 then for any 

XS W XS W > = 0, whence the corresponding integral is 0. We thus restrict 
ourselves to the case where, whenever oj \ I = uj' \ I, S u = S w r. In this case, 
we have 



u>e{o,i} k 

= 1 1 n (fxsj(hf i \...x k {k W(hix)d^ k - i) 

^e{o,i} fc 

=/ / n (fxsjx {i \...x k {k) w(h k 



2(fc-l) 



Since the inside of the integral is always non-negative, this term is non- 
negative. □ 

We set D(f)(h°) := J EU {0 ,i}Wo fQh ^ ■ ■ ■ > K^Wfr). Observe 
that ||/||^ = / / • D(f)d^(h°). 

Lemma 7.28. D (/) is measurable with respect to B k;k -±. 
Proof. It suffices to show that if ||E(/ | B k ,k-i)\ \ = then 

j f(h )D(f)(h°)d^(h°) = Q. 

Well, we have 

j f(h°)D(f)(h°w k (h°)=j f (h°) n fx 1 {i \...x k {k w k (h°X) 



=///(#) n f(h^ i \...x k {k) )d^h°)dAh 1 : 



we{o,i} fc ,^o 



Observe that, for a given h 1 , we have 

/ f(h°) n f\K {i \ 



X k (k) W k {h°) = o 



cue{o,i} k ,co^6 



since rLe{o,i}*>^5 f( h i ^■■■■> h k ) is <6fc,fc-i-measurable. The lemma 
now follows. □ 
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Theorem 7.29. ||/||^ >0i/ and only if ||E(/ | B fclfc -i)|| > 0. 

Proof. If \\f\\ u!L > 0, then / fD(f)d^ k (h°) > 0; since £>(/) is B k , k -v 
measurable, ||E(/ | Bk,k-i)\\ > 0. 

For the other direction, if ||E(/ | £>fc_i)|| > 0, we may find ^/-measurable 
Bj so that / / n Xb^h / 0, whence 

o < i / fUxsM < wfYixBjWu*, < H/ii^. 
j i i 

□ 

8. Soundness and Completeness 

Since AML is a variant of first-order logic, it is no surprise that AML satis- 
fies a completeness theorem with an appropriate set of axioms. Throughout 
this section, we fix a signature C. 

The following collection of axioms will be called AML. 

(1) FOL: A standard collection of axioms for first-order logic, 

(2) Q^°: All true quantifier-free sentences of (Q^°, +, ■, <, 0, 1), 

(3) Emptyset: 

(a) rag < 0.x\ x\ 

(b) rag > 0.x\ / x\ 

(4) Comparability: 

(a) Vz \s/x(p(x) — > ip(x)) — > (mj < t.ip — > rag < t.p)] 

(b) Mz\s/x(p(x) — > ip(x)) —7- (rag < t.ip — > rag < t.ip)] 

(5) Coherence: 

(a) Vz [rag < t.p — > rag < t.ip] 

(b) \/z[t < t' A rag < t.ip ->■ rag < t'.p] 

(6) Additivity: 

(a) Vz [(rag < t.p A mg < t' .ip) — > mg <t + t'.p V ip] 

(b) Vz [(rag < t.p A rag < t'.ip) ->■ rag < t + t'.ip V ip] 

(c) Vz [(rag > t.p A rag > t'.ip A rag < 0.(p A ip)) — > rag > t + t'.(<p V 

(d) Vz [(rag > t.p A rag > t'.ip A rag < 0.(p A ip)) — > rag > t + t'.(p V 

(7) Product: 

(a) Vz [(rag < t.p A rag < t'.ip) — > rag$ < tt'.(p A tp)] 

(b) Vz [(m^ < t.p A < t'.ip) — >■ < M'.(<£ A 

(c) Vz [(rag > t.p A m^- > t! .ip) — > rag^ > tt'.(p A ip)] 

(d) Vz [(rag > t.p A rag > t'.ip) — > rag$ > tt'.(p A ip)] 

We describe two additional families of axioms which we do not take to be 
part of the standard axiomization, but which axiomatize those structures 
with appropriate additional properties: 

(1) I is the following scheme of axioms: For any n and any permutation 
a of [l,n], writing a(xi, ... ,x n ) for (x a ^, . . . ,x CT ( n )), we have 

(a) Vz [rag < t.p -)• ra a ^ < t.p] 

(b) Vz [rag < t.p ra^g) < t.p] 
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(2) F is the following scheme of axioms: 

(a) Vz\(t < qr A Va?(^ — > mg > r.ip) A > q.ip) — > mg£ > t.(ip A ip)] 

(b) Vz [(qr < i A \/x(ip — >• < r.99) A mj < q.ip) —> < t.(ip A ^)] 

(3) F + is the scheme F plus the following scheme of additional axioms: 

(a) Vi* [(yx(ip — > mg > r.p) A > q.ip) — > mg^ > qr.((p A ip)~\ 

(b) Vz[(yx(ip — > mg > r.ip) A > q.ip*) — > mg^ > qr.(p A ip)] 

(c) [(Vx(^ — > > r.ip) A > q.ip) — > mg$ > qr.(p A ip)] 

(d) \/z \_(\/x(ip — > < r.(p) A < q.ip) — > mg$ < qr.(ip A ip)] 

(e) \/z [(\/x(ip — > mg < r.tp) A < q.ip) — > mg^ < qr.(p A ip)] 

(f) Vi* [(\/x(ip — > nig < r.p) A mg < q.?/;) — y mg$ < qr.(p A ip)] 

The scheme F + can be viewed as the "completion" of the scheme F; not all 
Fubini structures satisfy these axioms, but they may be convenient in some 
circumstances, and the most important structures — finite models under the 
counting measure and their ultraproducts — do satisfy these axioms. 
We first prove the following: 

Theorem 8.1 (Soundness Theorem). 

(1) Every axiom of AML is true in every C-structure. 

(2) Every axiom of I is true in every C-structure satisfying invariance 
under permutation of coordinates. 

(3) Every axiom ofF is true in every measured C-structure. 

Proof. 

• FOL: The FOL group is true as in standard first-order logic. 

• Q-°: The Q-° group is true because it is, by definition, the set of 
statements true of Q- . 

• Emptyset: The emptyset axioms are true because {c G M n : DJl \= 
Cl ^ Cl } = 0and0G^ n \i3^ n 

• Comparability: Suppose 5DT 1= \/x{p{x) — > tp(x)) and 9Jt (= mg < 
t.ip[s]. Then {c G M n : Wl t p[s(c/x)]} C {c G M n : Wl t= 
ip[s(c/x)]} C B for some B G B^ n , and therefore Wl \= mg < t.ip[s\. 
The other comparability axiom is similar. 

• Coherence, Additivity, and Product: If 9Jt 1= < t.p[s] then there 
is a B G B™t n such that {c G M n : 3JI N (^[s(c/x)]} C 5. By the 
coherence condition on we also have B G £>^' n , and therefore 
SOT 1= mg < t.<p[s}. The other coherence axiom, the additivity axioms, 
and the product axioms similarly follow directly from the properties 
of AML structures. 

• I: Suppose 97t 1= mg < t.p[s], so there is a B G B^ n such that 
{c G M n : Wl \= p[s(c/x)]} C i?. Since 9Jt satisfies invariance 
of coordinates, a(B) G £< t ' n , and therefore {c £ M n : Wl N 
V9[s(c/o"(x))]} C a(B), and therefore 9Jt 1= rrij^ < i.^>[s]. The other 
axiom is similar. 

• F: This is the content of Remark 13.71 



10 



ISAAC GOLDBRING AND HENRY TOWSNER 



□ 

We now turn towards the topic of completeness. 

Definition 8.2. Let T be a set of /^-sentences. 

(1) F is consistent if there is no /^-sentence <p such that both tp and ^<p 
are derivable from F. 

(2) F is complete if for every sentence <p in the language of C, either 
if G F or -193 G F . 

The following lemma is proven in the same way as for first-order logic; 
see [BJ. 

Lemma 8.3. If F is a consistent set of sentences in the language C, then 
there is a complete consistent set of sentences F' such that F C F' . 

Theorem 8.4 (Completeness Theorem). Let J- be a set of sentences consis- 
tent with AML. Then there is a model 9JT of F. If F is also consistent with 
AML + I, then we may assume that 9JT satisfies invariance under permuta- 
tion of coordinates. If J- is consistent with AML + F, then we may further 
assume that 97t is measured. If J 7 is consistent with AML + I + F, then we 
may assume 93T is measured and satisfies invariance under permutation of 
coordinates. 

Proof. For simplicity, we will assume that C does not include equality; the 
modifications for when it does are standard; see [6j. 

We define by recursion an increasing sequence {C a : a < uj\) of signatures 
and an increasing sequence (F a : a < uii) of consistent, complete sets of 
/^-sentences. Let Cq be the signature C. Let Fq be a complete, consistent 
extension of F U AML. Suppose that L a and F a have been constructed. 
Suppose n > and S is a countable set of sentences all of whose free variables 
are from {x\, . . . ,x n }. Further, suppose that for every ip\ , . . . , <p m G S, 
3x\3x2 ■ ■ ■ 3x n (ifi A • • • A (f m ) is a sentence in F a . Then fix fresh constants 
c l s for i < n and let C a+ \ be the signature consisting of C a together with all 
these new constant symbols for every such S. Define F^+i to be J- a together 
with the new sentences ip[c % s /xi] for each tp G S. It is immediate that F^+i 
is consistent. Let F a+ \ be a complete, consistent extension of Note 
that, by instantiating universal quantifiers, J- a +i contains the axioms for all 
formulas in the extended language. 

For a limit ordinal A < u?i, set C\ = U^<a-^/3 anc ^ ^"A = U/3<a-^~/3- 
Note that any tp in C\ is already in some Cp, so F\ is complete, and any 
contradiction in F\ was already present at some Fp, so F\ is consistent. 

We now construct a model 9Jt of F UJl . Let M be the set of terms of C m ■ 
For each function symbol /, set f m (t\, . . . , t n ) := f(t\, . . . , t n ), and for each 
predicate symbol R, set R m := {(t\, . . . , t n ) : R(t\, . . . ,t n ) G F W1 }. 

For each n, let Bq C V(M n ) consist of sets of the form {t : ip(t) G F Wl } for 
£ Wl -formulas ip. Let B n be the cr-algebra generated by Bq . For any B G Bq , 
define p(B) = m.i{t G Q >0 : mg < t.ip G F W1 }. Note that, using the 
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comparability axioms, p(B) is well-defined regardless of what representative 
<p we choose. 

Suppose B,C G B£ with BnC = i, = b, p{C) = c and let (p, $ 

be formulas defining B and C respectively. Then for any rationals b' < 
b,c' < c, {mg > b'.<f,mg > d.cp,mg < O.ip A -0} C J 7 ^, so by additivity, 
ra^ >b' + c'.ip V ip G For any r < 6 + c, we may find rationals b' < b 
and c' < c so that r < b' + d , so it follows that p(BL)C) >b + c. Conversely, 
for any rationals b' > b,c' > c, {m^ < b'.p,mg < d .ip} C and so 

< b' + c' .p V ip G J 7 ^ . Again, for any r > 6 + c we may find such d 
with 6' + c' < r, so p(B UC) < 6 + c, and therefore p(5 U C) = b + c. 

Now suppose A, A\, . . . , A n , . . . G £>q and A = \J { Ai where the Ai are 
disjoint. If there is some n such that A = \J i<n Ai then all but finitely many 
Ai are empty and p(A) = X^i<n/ i (^*) = X^M^i)- Otherwise, setting 
S = {3xA(x) A f\ i<n ->Ai(x)} consists of sentences in J 7 ^, and therefore 
cs G A \ \J i Ai, contradicting the assumption that A = (J^ Ai. 

By the Caratheodory extension theorem, each p extends to a measure p n 
on the B n which agrees with p on Bq . 

To show that fi m+n extends p m ® p n , it suffices to show that p m+n (B x 
C) = p m (B)p n (C) where B,C belong to B™ and Bq respectively, since 
these are dense subsets of B m and B n . But this is immediately implied by 
the product axioms. 

We complete the construction by taking B^ n to be precisely those B = 
{t : rri£ ix a.(p}. These sets are, by construction, measurable and compatible 
with the measure. 

If J- is consistent with AML + I, we may assume that AML + IC J r LJl . 
To conclude that 9JT satisfies invariance under permutation of coordinates, it 
again suffices to show this for any element of Bq, which follows immediately 
from I. 

If J- is consistent with AML + F or AML + I + F, we may assume that 
AML + F C T Wl . The same proof as in Proposition 13.61 shows that the 
measure /x satisfies the Fubini property, whence is a measured structure. 

□ 

Appendix A. First-order logic 

In this section, we briefly describe the basic syntax and semantics of first- 
order logic. 

Definition A.l. A. first- order signature is a set £ = ((cj)j e /, (Fj)j^j, (Rk)keK), 
where: 

• each Cj is a constant symbol; 

• each Fj is a function symbol; 

• each is a predicate symbol. 

Furthermore, each function and predicate symbol come equipped with an 
arity, which is a positive natural number. If n is the arity of Fj, then we 
say that Fj is an n-ary function symbol; likewise for predicate symbols. 
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The symbols in the signature C have no meaning on their own. In order 
to achieve meaning, they must be interpreted in an /^-structure: 

Definition A. 2. Suppose that £ is a first-order signature. Then an C- 
structure is a structure M which consists of a nonempty set M, called the 
universe of M, and such that M. provides interpretations of the symbols in 
C as follows: 

• For each constant symbol c in C, the interpretation of c in A4 is an 
element cr 1 G M; 

• For each n-ary function symbol F in C, the interpretation of F in 
.Mis a function F M : M n ->• M; 

• For each n-ary predicate symbol P in £, the interpretation of P in 
M is a subset P M C M n . 

We must stress that an /^-structure does not need to interpret the symbols 
of £ in a "sensible" way. For example, a group (G, -q, 1g) is naturally a 
structure in the language C = {-,1} consisting of a single 2-ary (or binary) 
function symbol • and a single constant symbol 1. However, the set {1,2,3} 
can be made into an /^-structure by interpreting c as 3 and interpreting the 
function symbol as the binary function which is constantly 2; this structure 
is by no means a group. In actual applications, however, structures usually 
interpret the symbols in a "natural" fashion. 

Suppose that M. and N are /^-structures with universes M and N re- 
spectively. Then a map j : M — > N is a homomorphism of C-structures 
if: 

(1) j{c^) = for all constant symbols c in C; 

(2) j(F M (a)) = F M {j(a)) for all n-ary function symbols F and all a £ 

(3) a £ P M ^ j{a) G P M for all n-ary predicate symbols P and all 
a G M n . 

We now wish to discuss how to express statements in first-order logic and 
to understand when a given statement is true or false in a structure. For the 
rest of this section, we fix a first-order signature C. We also fix an infinite 
set V of variables. 

Definition A. 3. The set of C-terms is the smallest set of (finite) strings of 
symbols satisfying: 

• If c is a constant symbol, then c is an £-term. If x is a variable, then 
x is an £-term. 

• If ti,...,t n are £-terms and F is an n-ary function symbol in C, 
then F(ti, . . . , t n ) is an £-term. 

Observe that £-terms name elements of the structure (after elements of 
the structure are "plugged in" for the variables). 

Definition A. 4. The set of C-formulae is the smallest set of (finite) strings 
of symbols satisfying: 
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• If t\ and t2 are £-terms, then t\ = t-2 is an £-formula. 

• If ti, . . . ,t n are £-terms and P is an n-ary predicate symbol, then 
P(ti, . . . ,t n ) is an £-formula. 

• If (pi and (p2 are ^-formulae, then -xpi and 991 A P2 are ^-formulae. 

• If ip is an £-formula and x is a variable, then \/x(p is an £-formula. 

The formulae in the first two bullets of the above definition are referred to 
as atomic C-formulae. In proving facts about all formulae, one first proves 
the fact for atomic formulae and then one shows that the fact is preserved 
under the connectives -> and A and the quantifier V; such an argument is 
said to be done by induction on the complexity of the formula. 

If p is a formula and x is a variable that appears in <p, then x can either 
appear free or bound in p, and the distinction can be defined by recursion 
on the complexity of formulae. If p is atomic, then any variable appears free 
in p. If x appears free in 99, then x appears free in -199. x appears free in 
pi A <p>2 if and only if x appears free in <p>\ or x appears free in <p2- Finally, 
x occurs free in \/yip if and only if x appears free in <p> and x 7^ y. We often 
write <p(xi, . . . , x n ) to indicate that all of the free variables of p are among 
Xl, . . . , x n . 

Fix an ^-structure Ai with universe M. A valuation on Ai is a function 
s : V — > M. Observe that any valuation extends naturally to a function 
s : T — > M, where T is the set of £-terms, by defining s(c) = c M for 
each constant symbol c of C and recursively defining s(F(t\, . . . ,t n )) = 
s(F- M (s(ti), . . . , s(t n ))). Given a valuation s on A4, a tuple of variables 
x = (xi, . . . , x n ) and a tuple of elements a = (ai, . . . , a n ) from M, we define 
s{a/x) to be the valuation on M obtained from s be redefining (if necessary) 
s on Xi to take the value a^. 

Definition A. 5. Given an £- formula p and a valuation s on A4, we define 
the relation Ai |= <p[s], read u Ai models p with respect to the valuation s" 
by recursion on the complexity of formulae: 

• M \= ti = t2[s] if and only if s(ii) = sfa)- 

• M \= P(h, . . .,t n )[s] if and only if (s(ti), . . . ,s(t n )) £ P M . 

• M |= -'(pis] if and only if M ¥= p[s]. 

• M |= pi A P2 [s] if and only if M \= p\ [s] and M \= P2 [s] . 

• M \= \/xp[s] if and only if M \= p[s(a/x)] for every a 6 M. 

One should think of Ai |= p[s] as saying that Ll p is true in Ai when 
every variable x is replaced by the element s(x) of M." Given a formula 
p(xi, . . . , x n ) and a valuation s on .M, it is rather clear that whether or not 
Ai |= p[s] holds depends only on the values s(xi), . . . , s(x n ). Thus, given 
ai, . . . , a n G M, we often write Ai \= p(ai, . . . , a n ) to indicate that |= 
p[s] for some (any) valuation s onX satisfying s(xj) = cij for z = 1, . . . , n. 

The notion of a definable set is of critical importance in model theory. 
Given an ^-structure Ai and X C M m , we say that X is definable if there 
is a formula v?(xi, . . . , x m , y±, . . . , y„) and elements b\, . . . ,b n £ M such that 
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X = {(ai,...,a n ) G M m : M \= <p( ai , . . . , a m , b u . . . , b n )}; if B C M is 
such that b\, . . . ,b n <E B, we also say that X is B-definable or definable over 
5. We may also write X = (p(M m ,b) or simply X = p(M,b) if m is clear 
from context. For example, if Q = (G, •, 1) is a group (treated as a structure 
in the natural language of groups mentioned above) and g G G, then the 
centralizer of g is a {^-definable subset of G, for 

C(g) = {hGG : g\=g.h = h-g}. 

Appendix B. Ultrafilters and Ultraproducts 

Given a first-order signature C and a family {Aii : i € /) of /^-structures, 
one would like to form an ^-structure M which logically resembles "almost 
all" of the Mi in the sense that, given any sentence a (of the relevant 
language), a is true in M if and only if it is true in "almost all" of the Mi- 
An ultrafilter on I gives us the appropriate notion of "almost all." 

Definition B.l. Let / be a nonempty set. 

(1) A nonempty set T of subsets of 7 is a filter on I if and only if: 

• i T\ 

• If A, B G J 7 , then A n B G J"; 

• If A G T and A C 5 C I, then B £ J 7 . 

(2) A filter on I is an ultrafilter on I if and only if it is a maximal 
(with respect to inclusion) filter on /. Equivalently, a filter £Y is an 
ultrafilter on / if and only if, for every subset A of I, (exactly) one 
of A and I\A belongs to I. 

Using Zorn's lemma, any filter on I can be extended to an ultrafilter on 
I. Since the set {/} is a filter on /, we thus see that ultrafilters on I exist. 

Given an ultrafilter IA on /, one can then view the statement u P(i) holds 
for almost all i" to mean {i G / : P(i) holds } G U. Observe that an 
ultrafilter on / can be viewed as a {0, l}-valued measure on V(I), in which 
case u P(i) holds for almost all i" agrees with the usual notion that u P(i) 
holds on a set of measure 1" . 

Example B.2. Let 7 be a nonempty set. For any i €. I, the principal filter 
on I generated by i is the filter Ui := {^4 C / : i G A}. Observe that the 
principal ultrafilter on / generated by i is an ultrafilter. 

When working with the principal ultrafilter generated by i$ G I, the 
statement u P(i) holds for almost all i" degenerates to the statement u P(io) 
holds." In measure-theoretic terms, the measure is concentrated on the 
set {io}- Since this clearly does not match the intuition of "almost all," 
one primarily works with nonprincipal ultrafilters on I. (There are more 
technically precise reasons for preferring nonprincipal ultrafilters, which are 
evident from our applications throughout this article.) Observe that a non- 
principal ultrafilter on / cannot contain a finite subset of /. Nonprincipal 
ultrafilters on / can also be shown to exist using Zorn's lemma. 
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Example B.3. Let J 7 = {A C N : A is co-finite}. Then J 7 is a filter on 
N, the so-called Frechet filter, that is not an ultrafilter. Any nonprincipal 
ultrafilter on N necessarily extends the Frechet filter. 

Suppose that X is a topological space. Given a family (xj : i G X) from 
X, an element x £ X, and an ultrafilter on /, we say that x is aU-ultralimit 
of (xi) if, for every open neighborhood U of x, we have {i G I : Xi G U} G U. 
In this article, we will need the fact that if X is a compact (hausdorff) 
space, then for every family (xj : i £ I) and every ultrafilter W on I, a 
W-ultralimit of (xj) exists and is unique; see Section 3.1 of [22] for a proof 
of this fact. In this case, we write lim^Xj for the ^/-ultralimit of (x,). If U 
is a nonprincipal ultrafilter on N and (x n : n G N) is a sequence from a 
hausdorff space such that lim n _ ) . 0O x n exists, then mm^oo x n = limjyXj. If 
X = R, then the usual limit laws for bounded sequences apply; for example, 
if (xj : i G I) and (g/j : i G /) are bounded sequences of real numbers, then 
lim w (xj ±Vi) = \vcau Xi ± lim w i/j. 

We now carry out our objective from the beginning of this appendix. 
Suppose that £ is a first-order signature and that {Mi : i G /) is a fam- 
ily of /^-structures. Given /, g G Oie/-^' we se * / 5 ^ an< ^ om y ^ 
{i £ / : f{i) = g{i)} £ W; in other words, ~^ is the just the rela- 
tion of almost-every where agreement of functions. Observe that ~^ is an 
equivalence relation on Y\ ieI Mi. We let M := Y\ iE jMi/ ~^ denote the 
quotient space. Given f = {fi : i £ /), we will write [f]u to denote its 
~^-equivalence class. M will be the underlying universe of a structure M, 
which is defined as follows. 

• If c is a constant symbol in the language C, then c M := [{c Mi )]u- 

• If F is an n-ary function symbol then set 

F M {[{a})] u , . . . , [«)]„) := [{F M *{al . . . , a?))] u . 

• If R is an n-ary relation symbol, then ([(oJ)] w , . . . , [(a? )] w ) G i?^ if 
and only if 

{iel : K 1 ,..., G i? Mi }GW. 

We call the structure .M the ultraproduct of {Mi : i e I) with respect to 
U and denote it by n^-^- The following theorem is sometimes called the 
Fundamental Theorem of Ultraproducts or Los theorem. 

Theorem B.4. Suppose that U is an ultraproduct on I and M = Y\u -Mi- 
Then for any C-formula tp{x\, . . . , x n ) and any {[{aj)]u, . . . , [{af )}u) G M n , 
we have M \= <p([(a})]u, ■■■ , [{af)]u) if and only if 

{iel : Mi \= y{a\,... ,af)} G U. 

The proof of this theorem is proven by induction on the complexity of 
formulae. We should note that the atomic formulae are taken care of essen- 
tially by the definition of M and that the fact that we are dealing with an 
ultrafilter rather than just a filter is essential in taking care of the negation 
clause. A detailed proof can be found in [6]. 
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Definition B.5. An ultrafilter U on / is said to be countably incomplete if 
there exist (D n : n G N) in U such that Do D D\ D D2 D • • • and such 

that n„ eN A* = 0- 

Observe that any countably incomplete ultrafilter is nonprincipal and any 
nonprincipal ultrafilter on N is necessarily countably incomplete; this is seen 
by taking D n = N \ {0, 1, . . . , n}. The importance of countably incomplete 
ultrafilters is the following proposition, whose proof we borrow from |14| . 

Proposition B.6. IfU is a countably incomplete ultrafilter on I, then M : = 
Q^-Mj is Hi- saturated: any family (X n : n G N) of nonempty definable 
subsets of M k which satisfies the finite intersection property has nonempty 
intersection. 

Proof. For simplicity, we assume that I = N; the more general case requires 
an easy technical modification of the argument we give. Furthermore, with- 
out loss of generality, we may assume that X n D X n+l for all n. If X n = 
{x G M k : M |= Lp n (x,a n )}, then set X? := {x G M? : Mi |= tp n (x,a£)}. 
Set J n := {i : X} D • • • D X" / 0}; by the Los theorem, we have that 
J n £U for each n G N. Observe that J n 5 J n+1 for each n. 

We now show how to construct a sequence (q) G Ilig/-^i such that, for 
each n, q G Xf for almost all i. This is easy to accomplish if (~) n J n ^ 0, so 
we assume that f] n J n = 0. If i ^ J°, let Cj G Mj be arbitrary. Now assume 
that z G J°. Let n« := max{n : i > n and « G J n }. Choose Cj G X,"*- 
Observe now that if n < i and i £ J n , then q G XJ 1 , whence q G J n . 
Consequently, for each n, we have {i : n < i} n J n C {i : q G X™} G 
since IA is nonprincipal. □ 
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